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ABSTBACT 

Analysis of the use of educational technology in 
public education reveals the following. First, technology is 
generally an added^on, teacher-dependent tool^ although tiiere is a 
trend to student-focused r individualized uses. Second, technology 
does not lead to increased learning^ although it can offer advantages 
such as time savings aixd curricular enrichment. Th^^rd, edocaticnal 
technology is expensive and as long as sti?dent time in school is 
fixed ind€;pendent of o-aarning, le^s capital intensive approaches will 
be more cost effective. Finally, the activities of the Federal 
agencies are focused upon the newer technologies such ks educational 
televisio:^, simulations, coKpuier-assisted instruction and multimedia 
systems. Thus, it: is evident that technology is not about to 
revolutionize education by radically lowering cosjts or increasing 
instructional effectiveness. There is a need for both the 
coordination of Federal activities in the erea of educational 
technology and for greater dissemination of information about 
successful implementations. Finally, educational technology's 
hardware needs to be standardized and more attent.^on should be paid 
to the use of technology for special applications and with special 
populations, rather than as a substitute for conventional 
instruction. (Author/PB) 
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EXECUTIVE SUMMARY 



This is a report of a policy analysis of educational technology in 
public elementary and secondary schools, conducted for the Education 
Division of the Department of Health, Education and Welfare, The analysis 
is intended to clarify a national debate of long-standing — What should 
be the role of technology in public elementary and secondary schools? 
Currently this debate is complicated by a thicket of more or less ex- 
travagant claims about the efficacy (or lack of it) of technology in the 
service of public education. This report is meant to be useful to policy 
makers and program planners in making more informed decj sions concerning 
the federal role in the use of technology in public elementary and sec- 
ondary schools. 

The analysis was based almost entirely on secondanry sources of In- 
formation^ including the literature, data archives^ and conversation^* 
with authorities in the field* We were guided by a working definition 
that views educational technology as priuarily consisting of instructional 
media. This definition is consistent with the one used in the report of 
the Commission on Instructional Technology; p. 21.^* We recognize that 
technology is more than just media, a point that is dealt with in Section 

Four ^questions were addressed/, Each cfuestion and a summary of the 
answer folloivs: , 

(1) How is education technology used in the schooJLs? 

Our ana;lysis of utilization, was based on a comparison of 
the definitive Godf rey^ data in the early 19606 with 
data available on current usage. In the early 1960s, 
technology was used infrequently and almost always as^ 
an "add-on" at extra cost. ^The critical element in 
technology utilization was the teacher, and in the early 
1960s tne teacher was not using much. Current information, 
while provisional, suggests things are pretty much the 
sane today. . The teacher still determines to a great 
extent the utilization of the technology. 



* 

References are listed at the end of Section VI. 



' - How©v0r/0everal trends wore idontiflod that distlngpuish 
curj:*ent ;patt0i^^ of utilization from f those t^h years ago 

♦ Wider Mae of simpler^ deylces/ suited for local pro- 
' dviotlort and student wanijpwlatiohi V ^ 

♦ Emphasis on technplogjj talj-ored to the xieeds of 
Undiyiduals. \\ ^ 

• More local school vauton(;)my in curriculum^ and budgeting^ * 
leading to decentralized deojl'sions regarding technology V 

How effective is the technology^ 

Virtually all of the rese&rch on the effectiveness oi^ 
technology in education finds* that 'technology is as 
effective it^ terms of standardized tes^t scores ae con- 

V ventional instruct j,on* ^l^e p^^ij(kary reasons for using 

^ technology (since it Ts alrtost always an added C;o$t) arei 

• ^ Enrichment of eo^yses where technology supplements the 

.teacherj e^g.^ audiovisual^ for art .instruction • < . 

# Saving tim^ (not alwa:^s desirable in a (public sphpol)/ 

• Bringing instruction to remote areas » ; - .^^.^ 

• Adding .subjectfi for whi^h tft^iQh^rs ajf^^ 

♦ 'Teaching technology,} e^,g»/ using computers to Ins^/uct 
in computer .programming, , , ^ 

(3) How it\uch does educational technology <?ost? * ' 

. Systematic^ detailed examinations of overall b^idgeta^^y 
costs were undertaken for *fi^ve, representative types of 
media* Results indiba.ted that at"" c^irrent prices^^^ 
instructional media to the present program of a sch6ol 

V can cost anywhere from $0 1 05 per studont^-^hour (for , 
printed .programmed infiitruction) to aliriOst ,^2,00,pQr 
student^hour (for computer based interactive instruction)-* 
though this figure may ^irop significantly in the next 
several year f ?or s comparison, conventional Instruction^ 
exc^lusive o]C^ buildings, •^administration, ' ai^d custodial 

, functions, costs about ^$04 42/student-hour • With present 
knowledge and organization patterns of public education, 
even a zero-costy^wertia^system with no classroom' or . 
operating persomxel ?iight^ save a school system at most 
11 percent of the total budget, and current uses of 
• V technologle^ would save considerably less, if anythingi 



at all. As lonr as student time in schools is fixed 
independent of learning, other less capital-intensive 
means of reducing costs, such as differentiated 
stiffing and year-round schooling^ appear more attrac- 
tive than technology. If this situation were to change 
(at the secondary level, for example), another look at 
. costs would be justified. 

(4) What have been the federal R&D activities in the recent 
past in the field? 

Most of the federal dollars have gone into R&D on the 
newer technologies: educational television, simulation, 
coraputor assisted instruction, and multimedia systems* 
The three federal agencies primarily involved in the 
field are the Department of Defense (DoD), the National 
Science Foundation (NSF), and the Office of Education 
(OE). The NSF devotes most of its funds to computer 
based instruction and to higher education. The DoD 
has a heavy investment in simulation. The OE invests 
in a wide range of technologies and forms of support, 
and targets more money than the other two^ to disadvantaged 
and handicapped audiences. 

All the foregoing suggests that technology is not about to revolutionize 
traditional public elementary and secondary education, either by making it 
significantly more effective or by radically lowering costs. It seems 
likely that public schools will continue to be dominated by patterns of 
instruction sanctioned by generations o^* use. Large scale and effective 
use of technology wi] 1 await fundamental changes in school organisation 
that seem unlikely in tlW near future. The most promising uses of tech- 
nology might be in are^s outside the one that we hfi^ve investigated, i.e., 
in higher education and in the education of specir^l-need groups. 

Finally, several recommendations are derived frcan the analysis: 

Claims about the power of technology to reform and improve 
public elementary- land secondary education should be 
moderated and brought into accord with the limited 
knowledge of the subject. 

Initiatives taken by the .Education Division should be 
formulated in the light of o:ther federal activities. • 
Investments in computer applications are an important 
case in point. Both DoD and NSF have made important 
gains in computer based instruction which should be 
built upon. 

xl 



(1) 



(2) 



ERIC 



r 



ERIC 



(3) The information about federal R&D projects in education 

is iaadequate. Since this type of information is essential 
to policy evaluation and reformulation^ steps should be 
taken to improve the appropriate federal information sys- 
tems. The Project and Grants Information System (PGIS) 
is the Education Division *s Computerized information sys- 
tem. This system is apparently inadequately financed and 
lacks the authority to obtain inputs from all sources. 

(4) There is no recent systematic information concerning 
utilization of technology in public schools. Since 
coherent federal policy should depend heavily on such 
information^ a utilization survey along the general lines 
of the Godfrey Study^ of the early 1960s is a high 
priority. 

(5) There is a need for some form of consumer (i.e.^ teacher) 
information on available materials (films in particular)* 
Information is needed that, would enable a user to identify 
materials suitable for a given instructional objective 
along with an evaluation of effectiveness* The Educational 
Products Information Exchange (EPIE) has made a valuable 
start in this direction for hardware. The Education Di- 
v:uSion should explore the dimensions of the demand for this 
type of information for software and mean.3 of supplying it. 

A related problem is th^^t hardware is often of poor quality 
and durability. Incompatibility is more the rule than the 
exception. The Education Division should analyze the 
Interaction between the technology industries and public 
education with a view to encouraging improved quality said 
standardization. Examination of the incentives for in- 
dustry to improve products and services seems a particularly 
high priority issue. 

(6) Education Division technology R&D expenditures were tar- 
geted mostly on "normal^ populations in both fiscal years 
1971 and 1972. This is inconsistent with the broad 
mandate for emphasis on the ^'disadvantaged*^ at the federal 
level. Analyses of these expenditures should be made to 
determine whether heavier investments in technology for • 
special problem areas^ especially the disadvantaged^ are 
appropriate* 
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Education Division policy should stress technology for 
special applications and not as a substitute for con- 
ventional instruction. There are a number of promising 
areas of special applications. These include: 

• Intensive instruction for the disadvantaged. 

• Technology for higher education. 

• New opportunities in adult and continuing education. 

There is not a sufficient basis in knowledge and ex- 
perience to nerrait the development of an integrated 
federal policy on such special ^applications . The 
Education Division should explore these applications 
with a view to conducting policy analyses* 
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I INTRODUCTION 



A recurrent theme in debates about American education is the potential 
role of technology in educational ^'eform. Each new device^ medium^ or 
process that emerges is typically hailed as the solution to a variety of 
pressing educational problems. This pattern has been followed with film, 
radio^ television^ and the com^^uter. 

In recent years the severe financial problems of public education 
have led to a search for m^ans of reducing costs. At the same time^ a 
growing number of observers have been criticizing public education. It 
i& not surprising in a period ot such ferment that many have seen in tech- 
nology a high potential for reform in general and^ more specifically, a 
means of increasing px'oductivity and improving the quality of education. 
This has led to what amounts to a national debate about the proper role 
of tecxinology in education. There is no systematic body of evidence to 
inform this debate; hence^ claims and counterclaims abound. Some s«e in 
technology the saviour of a severely malfunctioning educational system. 
Others see technology as a threat to a free democratic society. And in 
between are many more moderate positions and expectations. It is in this 
context that our analysis finds its basic meaning and purpose. 

Objectives and Scope 

One concrete objective of our work was to develop information useful 
to policymakers in the Education Division of HEW in understanding the 
basic issues involved in the debate. It is hoped that more informed 
decisions can be made based on this understanding concerning the federal 
role in education. al technology. 

As we proceeded with the analysis we reached agreement with staff 
members of the Education Division on several specific questions whose 
answers seemod most critical to an informed federal perspective. 

These were: (1) How effective has the use of educational technology 
boen in public elementary and secondary education? (2) How much does 
educational technology cost? (3) How is educational technology actually 
being used in public elementary and secondary education? 



To provide^ hopefully^ some wisdom from the pastj, we also agraed to 
revij^w recent federal R&D activities in educational technology. Through 
\ such a review we hoped to identify the major federal initiatives and the 
implicit or explicit theory behind those initiatives* 

Method of Approach 

Primary reliance was placed on secondary sources of data and infor- 
mation. Prominent amoug these sources were (1) the research ll^terature^ 
(2) various data archives and repositories (e.g.^ the Educational Resources 
Information Center)^ and (3) conversations with authorities in the field-^ 
and with educators. As always^ we found serious limitations in the avail- 
able data* In many cases^ it was t^unply impossible to reach any con- 
clusions. In others^ informed speculations seemed warranted. In still 
others firm conclusions were possible. 

One of our early and most difficult methodological problems was to 
define educational technology. While there is currently no agreement on 
any single definition^ there is fairly widespread acceptance of the idea 
that technology is more a syst^ o^ a process than a collection of devices 
and associated programs. The preferred definition of the Commission on 
Instructional Technology embodies most of the elements of a system 
definition: 

It is a systematic way of iesigning^ carrying out^ and evaluating 
the total process of learning and teaching in terms of specific 
objectives^ based on research in human learning and communication^ 
and employing a combination of human and nonhiiman resources to 
bring about more effective instruction (Ref. 1^ p.. 21). 

This definition avoids the problems inherent in viewing technology 
as simply a collection of devices. It allows for technology as an integral 
part of larger instructional programs^ such as differentiated staffing^ 
peer instruction^ and parent involvement* It also allows for viewing 
instructional technology as a, cohei^eut entity^ not the adding on of a 
hardware item here and there. 

However^ the systems definition has disadvantages as well. As the 
Commission on Instructional Tecl^^log^ points out^ "in nearly every case^ 
these media liave entered educatiok independently^ and still x>perate more 
in isolation than_^ln^^ombinationV (Ref* 1^ p* 21). This means that edu- 
cational teclmology as it is used in current practice «.is more educational 
media and their Associated soitv^aro than it is a systematic ma&ner of 
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creating and evaluating the entire teaching and learning process gnjided 
by objectives. Because technology is used in this way^ the Commission 
adopted the following working definition of educational technology: 

In its more familiar sense^ it means the media born cf the 
comiAunications revolution which can be used for instructional 
purposes alongside the teacher^ textbook, and blackboard* In 
general, the Commission's report follows this usage • In order 
to reflect present-day reality, the Commission has had to look 
at the pieces that make up instructional technology: television, 
films, overhead projectors, computers, and the other items of 
"hardware" aod "software" (to use the convenient Jargon that 
..^distinguishes machines from programs) — (Ref* 1, p* 21). 

^ Howard Hitchens of the Association for Educational Communications 
and^ Technology (AECT) has more recently grappled with the problem of 
defining the field of educational technology. He endorses the sys terns _ 
definition and agrees that educational technology is more than just media. 
But, he also goes on to point out that the systems definition is having 
difficulty being bom (Ref. 3, p. 3). 

Our final resolution on the problem of defining educational technology 
was to adopt the working definition of the Commission on Instructional 
Technology, as noted above. This amounts to defining educational tech- 
nology as essentially educational or instructional media.* 

In the pages to follow, we briefly report our findings on these 
four major subjects: 

» Effectiveness of educational technology in public elementary 
and secondary schools. 

• Cost of using technology in public elementary and t^econdary 
instruction. 

• Utilization of technology n public elementary and sacondary 
schools. 

• Inventory of recent federal R&D activities in educational 
technology . 

The report concludes with a section entitled Summary Implications 
and Recommendations. 



We are indebted to Howard Hitchens and James Wallington of AECT for 
guidance on this problem. 




II tPFECTIVENESS 



The examination of the effectiveness of educational technology was 
made in light of the larger question of the effectiveness of schooling 
as a whole. During this century, there has been much research on the 
effectiveness of schooling, but no definitive conclusions have been { 
reached. No one pedagogical method has been ^hown 'to be measurably ^ supe- 
rior to all others. A RAND review of the evidence on the effectiveness 
of schooling concluded that "Research has not yet identified a variant 
of the existing system that is consistently related to students' educa- 
tional outcomes." A recent analysis by Jencks et al.»^ reached much the 
same conclusion about effectiveness in the cognitive domain (as measured by 
test scores): "We see no evidence that either school administrators or 
educational experts know how to raise tost scores. Certainly we do not 
know how to do so." Jamison et al® examined many studies dealing with 
the effect on educational outcomes of variables from class size to per- 
pupil expenditures to teacher attitudes. They conclude that "What does 
emerge from those studies, and from the tabular summary, is a striking 
lack of uniformity concerning the significance of various variables." 
Their overall conclusion is that "few variables consistently make a dif- 
ference on student performance. This conclusion does not , however, 
imply that schools make no difference in the cognitive development of 
their students [emphasis theirs]. ... (However) it remains to be seen 
that variations in school inputs are consistently related to variations 
in school outputs." It is in the light of these conclusions about re- 
search on the effectiveness of schooling as a whole that we examine the 
effectiveness of educational technology. 

The effectiveness of any educational practice can be evaluated against 
any of a variety of criteria, or goals of education. In this study, we 
confined our definition of effectiveness primarily to cognitive effective- 
ness as measured by standardized tests. To the extent that the literature 
contained studies of the noncognitive effects of technology in education, 
we looked also at this; however, this was restricted for the most part to 
studies on the attitudes of students and teachers toward the technology, 
and the effects on student motivation. 

Due to limitations of time and resources, our study of the effective- 
ness of educational technology depended on summaries, overviews, and 
critiques of the existing research that have been conducted by others. 
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This means that we have not done a critical review of the many studies we 
looked at; rather, we have Just taken our sources at face value. A more 
penetrating look at the research on educational technology might weigh 
more heavily the results of research determined to be of high qua lit > 
(i.e., characterized by careful attention to experimental method, use of 
control groups » and so on). Such a study might also do an analysis of the 
quality and relevance of the software used in each experiment, and the 
effect of this on the learning outcome. Such analysis might well produce 
a different result than this study has. 

The overall conclusion to which all of the overviews of the field 
came was that the use of educational technology h&s been shown to be as 
effective as conventional instruction. As William H. Allen'' suggests, 
research demonstrates that people do learn from educational media and 
that this learning prevails under many different instructional conditions, 
with a variety of Subject matter contents, and with all kinds of learners. 
Chu and Schramm^ have arrived at essentially the same conclusion. 

A comment is in order regarding the nature of the effectiveness re- 
search that has been done to date. Almost all of the research has fol- 
lowed one model: the comparison of one medium, such as film (not further 
specified), with conventional instruction (not further specified). The 
fact that this type of research does not uncover any consistent evidence 
about the superiority of any medium over conventional instruction is 
ascribed by most reviewers to the poor model of research that has been 
adopted. Allen (Ref. 7, p. 6) noted that this^ model was adopted some time 
ago, and 

Even though this research is of questionable value ^ the reasons 
for conducting such studies at the time (and their counterparts 
with television and programmed instructiort in more recent times) 
are apparent: the educational establishment demanded proof of 
the effectiveness of these innovational techniques, and the 
baseline for comparison was clearly current teaching practices. 
As a consequence, the general perception of instructional media 
research even today is in these terms. 

Bearing in mind the very limited generality of the results of most 
of the research, we turned to the studies of individual media. Rather 
than discuss at length the studies that have been done on each medium 
here, we present some of the major studies in Table 1. Each of the 
studies listed reviews one or more experiments comparing media with con- 
ventional Instruction. For each study, the table shows the number oi' 
experimental cases where (1) the medium was shown to be significantly 



ERIC 



6 



B 
ft 
H 



u 



Z Q ^ 

s 

c 



00 tc »n 



X 0) 

-H > 

13 C 

c o 

V u 
a 

a a 

< ffl 



m »o n w 



^ a> n m w 



0) 

T3 > 

Q> -H 



o 



•a o 

3 C 



3 
T3 



> 
C 
Q 
O 

6 



0) 







c 






X 




>. 














tn 














CO 










u 






a 








c 




(0 






m 










"O 




a 






CO 


CO 




















u 






a 






CO 








a 






'c 










c 


0) 






(0 




c 


T3 


kl 


T3 


c 


73 


kl 




0 






0) 




0 


bo 




1 




1 


(l> 




0) 






C 


a> 


tt 


i 








fi 


0) 


0) 




a 


a 


e 


0 




CO 


e 


O 






ki 


CO 








m 






u 




0) 


u 








u 


bC 




0) 


kl 








1-1 






£i 


X) 






0) 




3 




0) 






•M 


x: 






o 


> 




a> 


O 


3 


u 




CO 


» 


x: 




CO 


DC 




a> 


a 




0 


ft 




ex 




CO 


Q 


CO 








u 










(X 


CO 


CO 




T3 




























o 










a 


0) 




































Pi 


H 





































0) tn 
be ^ 
d ^ 



o 
X 



< 
u 

0) 

B 
O 



s 



•a 
< 



7 



more effective, (2) no significant difference was founds and (3) "conven- 
tional Instruction" (as defined by each author) was shown to be signifi- 
cantly more effective. For more information on specific studies, see 
Appendix A. 

One characteristic of the research that is obvious from the table is 
that resuKs from different studies are not consisteut. The overall re- 
sult for all media except film is that no significant difference can be 
found froir conventional instruction, but some studies did find that the 
medium was significantly more effective than conventional instruction; 
some also found that conventional instruction was significantly more 
effective than the technology. This variation in results is further 
complicated by the fact that few of the studies are easily replicable; 
althou^^h some efforts to replicate studies have succeeded, many more have 
failed. 

One more interesting point illustrated by the table is that a greater 
percentage of the studies of the effectiveness of television showed a 
significant difference for elementary students than for secondary students. 
This is interesting, especially as it parallels the feelings of most 
teachers, students, and parents that television is a medium more appro- 
priate to elementary education than to higher grades » For example, both 
the Santa Ana Unified School District in California and Hagerstown use 
TV almost exclusively for the lower grades, and though^agerstown started . 
out with a lot of televised instruction for high school and junior high, 
its use at those levels has sharply diminished in recent years. 

In these studies, the things that have made the use of the technology 
more effective are the same things that make conventional instruction more 
effective: good organization of material, a practiced delivery, strong 
Student motivation, integration of knowledge of the effects of the instruc- 
tion into the teaching, rest pauses at appropriate times, and cues that 
direct pupils to those points essential to learn. There is no consistent 
evidence that making the nedia more sophisticated enhances ef f ectlveness - 
For instance, for televised instruction, there is no consistent evidence 
that color, animation, humor, or dramatic rather than expository presenta- 
tion improves effectiveness, although it does attract a larger audience — 
Sesame Street is a prime illustration of this. 

Both programmed instruction and computer assisted instruction (CAI) 
have often demonstrated dramatic reductions of the student time required 
to complete a unit of instruction. This saving of time is not as useful 
to a school as it would be to industry, or to the military, where time is 
money, for public schools have a custodial function to perform that requires 
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them to keep students in school and occupied for a certain number of hours 
a day and days a year. Although saving time may not save money, it can 
still be of use to schools. If a school were interested in expanding 
its curriculum J or adding opLlons like work^-study programs, for instance, 
this time saving might be significant and useful. Of course, adding to 
the curriculum oft^n means the expenditure of more resources, so this 
might be more expensive for the school. It has also been suggested that 
this time savings means that these media are especially appropriate for 
remedial instruction, since they would allow children that are far behind 
to catch up before their contemporaries get too far ahead of them. 

Table 1 summarizes the result of studies along cognitive dimensions. 
It is interesting to look at some of the noncognitive aspects of computer 
assisted instruction. Students felt that computers had greater expertise 
than teachers, and were clearer in their presentation of material and 
fairer in grading, since the computer graded only on task related items 
while teachers often graded on other items, such as behavior in the 
classroom . 

The fact that the computei has been found to be mere effective than 
teachers in certain dimensions, and that films have been more effective 
than verbal instructions in conveying certain kinds of concepts, suggests 
that if we could successfully match student characteristics, character- 
istics of the subject to be learned, and attributes of media, the media 
might be found to be consistently more effective- This thought has 
occurred to many educat ionr*. 1 research:irs , and is the basis of the study 
of what is called Aptitude-Treatment Interaction. Allen (Ref- 7, pp. li, 
12, 14, 15) summarizes this research: 

The study of this three-way interaction of stimulus, task, and 
learner is extremely complex, but some evidence is building up 
that could lead to a more precise understanding of the place of 
media in the instructional process. ... The time Is far off, 
if in fact it ever arrives, when we can identify an instruc- 
tional problem and then faultlessly select the proper, instruc- 
tional mix to solve it. ... There is reason to expect that 
the present growing attention being given to the study of the 
unique attributes of instructional media and their relationships 
to the characteristics of the learner and the nature of the 
instruct iorial task will be increased in the future. ° The folly 
of assigning generalized and all-inclusive attributes to spe- 
cific classes of media (e.g. » television^ film» print, computei*- 
assisted instruction) under all conditions is finally being 
appreciated, and we should observe more intensive research 
efforts to discover how to design and manipulate the media so 
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Ill BUDGETARY COSTS 



The costs of ^instructiona 1 technology in the sense of the 'things 
of learning"^ ^ orCinstructiona 1 media were reviewed to answer two ques- 
tions: (1) what would each of several specific technologies cost a school ' 
district to use as an integral part of instruction? and (2) how much might 
the use of technology be expected to save a school district? The scope of 
these questions was confined to budgeting costs as opposed to the broader 
concept of social costs (e.g., the opportunity cost of student time spent 
In school). In order to answer each of these questions realistically, we 
made a detailed specification of the ways in which a school district 
would employ an educational techno logy"-the number of pupil-hours per 
yc. r that the technology is used, the number of subjects that are taught . 
using the technology, the number of classrooms that would share the use 
of any piece of equipment, and, most importantly, the flexibility of 
scheduling needed to fit each medium into instructional procedures of 
schools . * 

Present Budgetary Costs of Selected Instructional Technologies 

The most natural source of budgetary cost estimates would be school 
district budgets. Unfortunately, the accounting and record-keeping sys- 
tems of the nation's schools do not provide adequate cost information, 
since these systems are neither complete in themselves nor comparable 
across schools.^* Cost estimates already available in the educational 
literature, on the other hand, vary widely both in dollar amounts and in 
the care and completeness with which they were determined. Some are 
ballpark estimates, offering only a very rough approximation of the cost 
per student-hour and including no description of the conditions under 
which they were obtained. A few sources supplied timely detailed, and 
reasonably complete cost breakdowns, specifying prices for each piece of 
equipment, salaries of personnel, and operational and maintenance costs. 
For these few, costs per student-hour are calculated through a series of 
assumptions about every aspect of use: the expected life of hardware and 
courseware, the number of students that use it and over what periods of 



Thus explicitly, this study was oriented toward hypothetical reconstruc- 
tions of public education around the use of different technologies. 
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Th e Teclyiologiefl Sxamin^d ^ )^ ~ ^ . ' 

The limitations of time permitted etudyii^g ortly a few techsologlefi % 
in suitable depth. Thode selected yt^fo (I) broadcast, cable and vid^>^ 
cassette Instructional television; ,(2) I6mm filwj (3) programmed text} 
(4) computer based Instruct'lon; and (6) aitdlo cassette dound-fiimstrlp. 
The first two medl0 wer^ considered tjor group instruction, the second 
two for individual instruction, and the last for both* .Th0 toedta ex^m*' 
inedi therefore, span four basic hardware technolo'glea of widely varying - \^ 
complexity--prittt, audiovisual, .television, a^d computer— and inplude both \ 
individual and group mbdes of presentjition. ^ . ' 
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Component costs for each of .these technologies were gathered from - 



the sources mentioned previously, plus market report^, catalogs and equip- 
ment directories! Every effort was pade to bring coata up to date and to 
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include several different delivery syscems for the major technologies 
(such as videoc '^set te television systems), although reports from sup- 
pliers of expected sharp reductions in the cost of color television equip- 
ment caused us to concentrate on monochrome television in this study. The 
Intent here was to describe the current cost situation rather than to 
forecast future developments- For computer based instruction this meant 
attention was paid to systems that hrve actually been employed in elemen- 
tary and secondary schools for simple dri ll-and-practice and tutorial in- 
struction, rather than the more advpnced systems such as PLATO IV and 
TICCIT that are under development .^^^ Neither costs nor pattevns of uti 
lization have been established for these sysvems in enough precisi n and 
detail to permit cost estimation on a comparable ba?is with the other 
technologies (media) considered. 

Method of Approach* 



In brief, for all the media examined, a set of common instructional 
tasks for e?ch media system to perform and a set of environments (numbers 
of students and geographical areas containing them) over which to perform 
those tasks were defined. Three instructional tasks were chosen to cover 
different intensities with which a medium might be used- Tasks are exr 
pressed in terms of an average number of contact minutes (per student) 
with a media system per week or per day. The values selected were 20 
minutes per week, 20 minutes per day, and 60 minutes per day. This di- 
mension is called the intensity of media use. The 20-minute unit was 
chosen because it approximates the average length of films and is reason- 
able for other media. 

To limit the size of the modeling effort, the number of environments 
was limited to four, designated Local District I, Local District II, City, 
and Metro : 

(1) Local District I— An ex-urbati local district of 10,000 
students spread over an irregularly shaped 53 square miles 
in ten elementary schools and three secondary schools- 

(2) Local District II — suburban district or pair of districts 
having 30,000 pupils in a rectangular area of 50 square 
miles housed in 34 elementary schools and seven secondary 
schools , 

The basic framework of analysis is an extension of that employed by the 
OE-sponsored General Learning Corporation study of 1968. More details 
on methodology are inclv^ded in Appendix B. 



(3) City- — A city-wide district or consortium of districts 
having 150,000 pupils over a rectangular area of 70 
square miles ^ housed in 169 elementary schools and 

35 secondary schools. 

(4) Metro — A metropolitan area consortium of districts 
having 600,000 students contained in an irregularly 
shaped area of 1,500 square miles in 67.7 elementary 
schools and 139 secondary schools* 

The dimension describe<^ in the above categories is called, the extensive- 
ness of rtt^dia use. These specifications of intensiveness and extensile-' 
ness cover a sufficiently broad ij£n&«* to permit examination of different 
media systems over- the same but widely' varying set of circumstances. 

So that th cost estimates incorporate all factors for which school 
districts must realistically budget in the adoption and effective use of 
media instructional systems, each element of cost was categorized as 
direct or support, and estimated separately. They were then cross-, 
categorized as either one-time costs (applicable to items having a useful, 
life of more than a year) or recurrent costs (items used up within a year, 
or purchased annually) .^^ Initial planning^ administration^ and testing 
and evaluation for system improvement compose the support costs. The 
direct cost elements included were: ■ 

Initial teacher and administrator training 
Facilities 

Initial equipment and courseware 
Operation of equipment 

Maintenance of equipment and facilities 

Continuing teacher planning^ and training < 

Related classroom rhateria Is for planning and scheduling. 

To compare instructional systems having different proportions of 
one.-tlme and recurrent costs, each one-time cost \\as amortized over its 
useful lifes at 10 percent interest and added to the costs to form an 



In general, the liie of locally produced courseware was' taken to be three 
years, purchased couisewa re and some equipment five yeais, other equip- 
ment ten years, and buildings 25 years. Each media system was assumed 
to be used 'loQc tea years with the exception of cxjmputer based instruction 
where rapid technological advance was assumed to render current systems 
obsolete in five years. Annual costs were then derived from tliese value s- 
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equivalent annual cost. The resulting single figures can then be examined 
across technologies and across changes in intensiveness and extensiveness 
of use. 

The cost figures obtained reflect the purchase of all hardware and 
the purchase or (for television and computer- based systems) the lease of 
alJL courseware needed by the school district or consortium of districts 
to implement a technology. Thus the figures represent full costs, the 
costs of starting from zero inventory, ratheT than the incremental costs 
of addinggto whatever inventory of equipment, materials, facilities^ and 
specific training that the school district(s) might already possess. For 
the audiovisual media and programmeu text those inventories can be sub- 
stantial, although some of the material might be obsolete or in bad 
repair and thus not suitable for regular use in instruction. 

p^he costs of classroom personnel (other than training costs) are not 
included as instructional systems costs^ because deployment of classroom 
personnel is quite flexible and not closely coupled to the technology in 
use. Indeed, various technologies may be used as elements of a given i 
team teaching or differentiated staffing plan thai, reduces instructional 
staff co^ts. However, one would be hard put to determine how essential 
the technologies alone are to such a plan. Instead ^ the consideration of 
how much media instructional systems might save a district will deal with 
straight substitution of iredia Instruction for classroom teachers^ the 
most radical use contemplated, with differentiated staffing (possibly 
involving media use) viewed as an alternative approach. Meanwhile, esti- 
mates obtained in tlils part of the study essentially represent the costs 
of adding" each system to present school expenditures. 

Some Caveats on the Present Met-hodology 

The patterns of utilization for evhcj technology ^ re specified on 
the common basis of full integration into each school ^s curriculum as a 
m^^an.c) of direct inatruction rather than as a supplement to traditional, 
activities. This is not necessarily the way each is used, and this 
specification can have^ a slgnificani impact on costs per student -hour* 
Thus ISmm film is represented, tiot in its usual role as a medium on 
call by each teacher for supplementation, but as a means of direct in- 
struction used by many schools simultaneously during a" given period each 
year. Integration into the curricul&m is represented by the requirement 
that each film title be seen at the appropriate poin^ of the school year 
by all intended sttident viewers in all schools during a single three-week 
period of instructional relevance. During the rest of the school year the 
film is unused. Most of the costs reported here for 16mm film a^e^^ 
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result of the large number of prints of each title that are required to 
fulfill this task in this fashion. This is the most extreme example of 
the impact of scheduling and the role of technology on its costs, but 
the lesson it teaches about the need for careful specification and full 
explanation of procedures extends to all other technolo{;ies considered* 
For this reason. Appendix B contains a complete explication of the 
methodology, and the design specifications for each technology (including 
the several television and computer based systems examined) . 

One additional general point is that the estimates for the life 
of the courseware used in each system (three years for internally produced 
courseware, five years for courseware from commercial or nonprofit national 
sources) reflects the time that the materials could be expected to be 
"current" in terms of curriculum revision and pedagogical quality in a 
district. These figures do not reflect the time that it actually might 
be physically possible to use the courseware without regard to instruc- 
tional utility (e.g., films tend to become ql^blete before they are worn 
out). 

Both these caveats reflect the consequences of the choice made in 
this study to obtain costs for technologies used as Integra 1, constantly 
updated direct instructional delivery systems that could potentially sub- 
stitute for teachers. The study of the costs of audiovisual aides, occa- 
sional television use, or small-dcalej, less frequently updateci instruc- 
tional materials might obtain different results, but these latter could 
not be extrapolated to the higher intensities of use or integral instruc- 
tional roles considered here. 

Results of the Calculations* 

The direct costs for each technology are shown in the bar charts of 
Figures 1 and 2. These charts allow the reader to see how economies of 
scale depend on student user population (extensiveness of use) and on 
minutes per day of Instruction (intensiveness of use). Each bar shows 
an aggregate of production^ distribution, presentation, and support costs, 
as indicated by the letters P, D, and S; the total height of a bar 



The reader who is Interested in more details than can be given here or 
in Appendix B concernirig the methods used to reach the cost estimates 
may write to SRI, 333 Ravenswood Ave., Menlo Park, California 94025, 
Attn: Mr. Norman B. McEachron. 
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shows the cost of one technology in te^ms of dollars per studen^:-hour 
(left scale) and the equivalent annual cost (right scale)* The cal- 
culations are based on 20-minute units of instruction in both elementary 
and secondary schools. Figure 1 shows the data for all four em ironments 
at one level Ox intensiveness (20 min/day). Figure 2 shows one environ- 
ment (Local District II, 30,000 pupils) at three levels of intensiveness. 
The left scales are kept the same among the charts; the reader should 
be alert to the changes in the right scales of Figure 2 with changes in 
intensiveness. All production cost estimates reflect the increased 
quantity (and estimated quality, if internally produced) required at 
city and metropolitan levels. 



Explanation of Abbreviations 

P: Production Costs — Production includes all costs of design and 
production by the school district or consortium, or acquisition by pur- 
chase or lease, of the instructional content or courseware from which 
the student will eventually learn. For 16mm film, sound-f ilmstrip, 
and programmed text, this consists entirely of selection and purchasing 
costs • 



D: Distribucion Costs — Distribution includes all costs of content 
to the learning site (school), its reception there, and the return of 
any learner feedback essential to subsequent instruction. For computer- 
based instruction, this includes costs of data transmission to and from 
student terminals. 

R: Presentation Costs — Presentation represents all costs of process- 
ing the instructional content to a form suitable for learning, displaying 
it to the student at the learning site, and obtaining any essential feed- 
back. It Includes not only purchase and operation of necessai^ hardware 
(e.g., computers) but also teacher training; however, it excfludes the 
salary costs of classroom personnel. 

S: Support Costs — Support costs (initial planning, administration, 
and evaluation) were estimated for each system as a whole. 



Group Instruction — The group mode of presentation encompasses four 
technologies. These aro listed below, under ITV: , 
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ITV: Instructional television systems with a mixture of 
local production^ film^ and national television agency 
rentals as sources for programming (all rentals taken at 
20 min/wk) • Quality of local production increases with 
the viewing audience, 

ITFS: Instructional Television Fixed Service as the 
distribution system^ with videotape recording and 
playback in local schools (none at 20 min/wk^ high 
schools only at 20 min/day^ e^lementary and secondary 
at 60 min/day) as required to meet scheduling re- 
quirements. Videotaping costs are allocated to 
the presentation function (K above) . 

CTV: Leased cable distribution system (Pacific 
Telephone Company rates) of up to six channels (at 
20 min/day and 60 min/day) with high school video- 
tape recording and playback at 60 min/day. 

UHF: Rented broadcast time from one to two local UHF 
educational broadcasting stations, with in-school 
videotape recording and playback facilities at 
20 min/day. Channel capacity is insufficient to 
carry the 60 min/day programming requirement, 

VT: School-level video cassette playback centers^ 
each supplied with tape duplicates of required pro- 
gramming stored in school libraries for three years' 
use before recycling* 

16mm: Sixteen-millimeter film distributed from central 
film libraries having enough prints to show a given 
program to all students within a three-week ^'window'' 
of instructional relevance. (A wider window would 
lower the production or film print costs.) 

♦ SF-Group: Sound-f ilmstrip (cassette format) shown by 
teachers to individual classrooms in groups^ with 
f ilmstrip libraries maintained at each school. 



Individual Instruction — The individual mode of presentation encompasses 
the technologies listed below: 
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• SF-Indiv: Sound-f ilmstrips viewed by students in an 
individualized instruction format in carrels, with 
sufficient courseware provided to permit every s+udent to 
view a given title within three school weeks- 

• Prog. Text: Programmed text used individually by students 
at home or in school. 

• CBI : Drill-and-practice and simple tutorial instruction 
administered by computer. Distribution costs refer to 
data transmission between school site and computers. 
Presentation costs include the items shown. 

DMC: Minicomputer systems designed to use only 
commercially available courseware, not user- 
originated programs or general-purpose problem 
solving. Production costs indicate lease costs of 
courseware. All computers are located within 
schools* At 20 min/wk and 20 min/day, some terminals 
are operated by computers located in other nearby 
schools. Terminals are Teletype*^ machines^ Model 33 
KSR. • ■ 

TSM: Minicomputer systems, designed to permit gen- 
eration and operation of teacher-produced couseware 
as well as general problem solacing using available 
computer languages (BASIC). Production costs are a 
mixture of internal production teams (expenditures 
and quality assumed to increase with student user 
population in a fashion similar to ITV) and com- 
mercial rentals. Distribution and presentation 
are similar, to the DMC systems. 

CTMP: Large, centralized computer facilities, each 
operating up to 1,000 student terminals on a variety 
of instructional programs, including problem solving 
as well as commercially available materials. Sub- 
stantial operating costs are incurred for central 
staff. Terminals are again Teletype^ Model 33 KSR. 

DCCP: Large centralized computer facilities, each 
operating up to 500 terminals located in different 
schools, linked by leased phone lines. Systems use 
only the leased courseware also employed by the DMC 
systems. Terminals are CRT (cathode ray tube) type 
having more flexibility than Teletypes, but at higher 
cost. Production costs are courseware lease costs. 
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Discussion of Results 



The results indicate that costs of technology currently available 
fit into a general ordering across different environments and intensities. 
General-purpocse computer based systems are more expensive than the 
specialized drill-and-practic<^ systems, followed by 16min film (with the 
caveat previously mentioned), various foms of television (including 
videotape replay facilities in schools where necessary), sound-f ilmstrip^ 
and finally a very small unit cost ($0.05 per student-hour) for programmed 
text • 

The bar charts of Figure 1 show that significant economies of scale 
over variations in extensiveness occur only for various forms of broad- 
cast television and the large computer systems. The estimated cost of 
instructional television using ITFS and recording and playback facilities 
in the high schools at 20 min/day declines from about $0.80 per student- 
hour to almost $0.30 per student-hour as the student population increases 
frpn 10,000 to 600,000 pupils. Economies of scale are limited by the 
expense of the playback facility, since the cost is proportional to the 
number of schools; thus, the cost per student for the facility does not 
decline as the number of schools, and the number of students, increases. 

The reader will note that the bars dealing with computer systems 
show more detail than the other bars; in the CBI cate:;ory, the presentation 
costs (R) are broken down into four subcosts — Processing and Memory, 
Terminals, Facilities and Supplies^ and Proctors, xree 3ntation costs 
dominate, the total costs of computer based systems in the models of this 
report. The cost of Sjtudent terminals forms a significant element of 
presentation costs, especially for the DCCP system in which cathode ray 
terminals (visual displays similar to television) are employed in place 
of the teletypewriters of the other three systems. 

Intensiveness is measured in terms of the amount of instruction per 
unit time received hy each student in a district of given characteristics. 
Figure 2 displays the scale economies for a 30,000-pupil district, grades 
1 through 12, or about two suburban districts operating a joint system. 
When a pupil receives instructional television via ITFS for 20 min/wk, 
the cost is about $0.60 per student-hour. When intensiveness increases, 
there is an increased need for in-school recording and playback facilities, 
and thus no economies of scale are observed. On the other hand, such 
economies are quite significant for the larger computer systems, the 
capacity of which to supply student terminals is more efficiently utilized 
as the total number of student terminals increases, both from increases 
in extensiveness (Figure 1) and intensiveness (Figure 2). 
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Potential Bndgetary Savings from the Use of 
Instructional Technologies 



The preceding cost estimates reflect the current (1973-74) capabilities 
and price structures of technologies, some of which — particular computers 
and television production and presentation — are changing rapidly. Thus 
current estimates may not accurately represent future possibilities* 
Furthermore, the- costs of the instructional personnel required to be 
present during use of the media were excluded, on the grounds that local 
practice varies widely on this point. Yet the posBibillties of cost 
savings through the use of an instructional technology depends on its 
potential for reducing classroom personnel costs. 

Because of such uncertainties, these cost estimates are insufficient 
to determine the unique possibilities that instructional technologies may 
offer to reduce the costs of elementary and secondary educatiofi as cur- 
rently organized. An alternative approach has therefore been developed. 
The thrust of this approach is to obtain an upper bound on potential cost 
savings attainable under current knowledge based on.the substitution of 
media instruction for classroom teaching within schools* This is the 
role that technology must play if it is to be essential to cost savings, 
rather than occupy a supportive role* The approach is limited in that 
it assumes the continuation of Instruction at designated learning sites 
(schools) rather than at homes or other locations. In this sense it 
represents possibilities for savings and redeployment of resources short 
of major redefinition and reorganization of elementary education; thus, 
the approach represents possibilities for the near term future* 

An upper limit on potential cost savings within the bounds of 
present knowledge and organization can.be evaluated if it is assumed 
that the technological system itself costs nothing and that no classroom 
personnel are required during its use. This means that the use of tech- 
nology for an instructional task is assumed to reduce to zero the budgetary 
costs of that activity* 

The following examples indicate that the upper limit of experience 
with various forms of instructional technology in current institutional 
settings is almost certainly less than 25 percent of instructional time: 

• The elementary school systens in both Washington County, 
Maryland, and Anaheim, California, (the Ford Fouidation- 
sponsored pioneer systems) use television to carry between 
11 and 13 percent of total instruction. Other ETV systems 
provide less intensive use*^^ 
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• Computer assist^^ instruction in elementary and secondary 
education rarely rises above 20 minutes per day per pupil^ 
less than seven percent of the instructional time.** 

• The Carnegie Commission has suggested aj$ a reasonable ex- 
pectation for the year 2000 that between 10 and 20 percent 
of on-campus instruction be carried out using some form of 
instructional technology .^^ 

• University-level multimedia approaches to instruction 
(including slide or filoistrip plus audiotape^ and 
videotape) rarely entail more than 20 percent of total 
time being spent using technological alds.^' 

• Adult enrollees in the British Open University spend only 
about five percent of their learning time occupied with 
television and radio presentations.^^ 

Thus we conclude that the upper limit of budgetary cost savings to be 
anticipated using forms of instructional technology now envisaged is 
from 10 percent to less than 25 percent of total instructional costs, 
even if the technology (including equipment, supplies, and furniture) 
is costless and requires no classroom personnel -whatever. In contrast, 
the Anaheim Elementary School District has claimed savings corresponding 
to approximately three percent of instaructionaj; expenditures in com- 
parison to the cost of presenting their television-augmented curriculum 
by traditional means.* 

To express these cost savings in terms of overall costs of elementary 
and secondary education, we. examined the program budgets for typical U. S> 
elemontary and secondary grades as prepared by Education Turnkey Systems. f' 
Excluding, as we have previously, the expense of ^uildingn to house 
students as a constant (this presumes zero cost j± alterations required 
to use another, technological system for instruction), the instructional 



This was calculated on the basis of the typical program budget reported 
in the next paragraph. Annual savings of $152,000 reported in Teaching 
with Television (see Ref • 30) were compared with 44 percent of the 1971-72 
total district expenditures of $13, 220, 000 (obtained from Assistant 
Superintendent Franzon) . The former is 2.6 perceat of the latter c 
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function takes up 44 percent of total costs^ including supplies, equip- 
ment, and furniture*'*' A 10 to 25 percent savings in these costs wuld 
then amount to 4.5 to 11 percent of the total costs of instruction. We 
conclude that even by the most optimistic estimates cost savings from the 
use of technology would not be more than 11 percent of the total cost of 
elementary and secondary education, using any technology now envisaged 

and the highest levels of usa that have been sustained in practice in * 
developj^d countries. While not negligible, these ' savings do not represent 
the kinds of radical cost reductions that technology has attained in 
industrial applications. 

To further evaluate the attractiveness of these codt savings to 
school districts, we must consider alternative ways to reduce costs. 
Typical means employed by districts to cut expenses include eliminating 
courses or activities of lesser priority, cutting back on the use of . 
media (including subsidies to ETV stations that typically carry courses 
of lowest priority), increasing, th^ pupil-staff or pupil-teacher ratio, 
and increasing cla«s «ize (which has been shown not to affect, cognitive 
achievement). These approaches can easily match the savings to be ex- 
pected even from costless instructional technologies* More systematic"^ 
means /of reducing costs have been described by Cresap,/McCormick, and 
;^agetJ Inc.®* "^^y indicated that the mdst substantiial cost 
f saving derived from redeployment of instructional personnel using 
dlJfeirenti-ated staffing. The overall cost reductions Indicated over 
five Isize categories of school dieTtricts correspond to about 8*5 percent 
of total costs, in the mid-range of savings using a costless technology^* 
and well above the savings on total (Instructional plus* custodial) costs 
of the television-expanded cufi^iculim reported by the Anaheim xnatructiohal 
television system— atout 1 . 5 percent. The comments of the CMP staff con- 
certjiing instructional technology are intersting in this regard: 

A review was made of research findings on opportunities to ^ 
lessen educational costs through greater use of xelevision, 
computers, and other technological developments. Definitive ^ 
cost data are lacking, but it does not appear that the use of 



This estimate includes only the costs actually incurred in classroom 
iBistruction and preparation for instruction; it excludes all custodial 
and staff . services— 'SUCh as recess, physical education, lunch,' ho«aeroom, 
transportation, principal and staff ^services, and district a(|ministra- 
tion^-that would not be, replaced by technology. ^ 
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instructional technology in itself holds promise for cost 
reduction (unless a massive restructuring of the form of 
education is hypothesized). (Ref. 34^ p. 12.) 

Other cost savings of approximately four percent in the ptirchase of 
supplies and equipment and the furnishing of support services were sug-^ 
gested^ by CMP. The total savings potential estimated by CMP^ without 
the major capital investment that would be required for most schools to 
employ technology Intensively^ would exceed the maximum possible savings 
from such a major capital investment. 

\ 

Finally^ Education Turnkey Systems^^ (on the basis of a pilot program 
of a 45:15 plan* .instituted in four schools of Prince William Gounty^ 
Virginia) estimates overall savings in the 1971-72 per pupil cost of 
education of 4.9 percent from more intensive use of staff and 4.7 percent 
from more intensive use of capital facilities. The .total cost saviugti 
of 9.6 percent is at the upper encf of the range for a costless instruc- 
tional technology. t Again^ this approach requires no capital investment 
beyond planning expenses. 

We are therefore forced to conclude that^ for the kinds and levels 
of use of instructional technology with which researchers to date are 
familiar^ the cost savings obtainable are not large, and at present are 
simply not as attractive as other, more immediate and less capital- 
intensive means of reducing costs, no matter how inexpensive the technology 
may be.. The promise of technology in elementary and secondary education, 
within the confines of present knowledge ana organization,' lies not in 
directly substituting for classroom teachers, but in aiding their in- 
structional activities. This can be done by improving the capability of 
^ a differentiated teaching staff to individualize Instruction (Ref. 34, 
p. 15) and by performing tasks that classroom teachers cannot do well 
(which may include some aspects of ^nstruption for the disadvantaged and 
handicapped). The possibilities of significant cost savings, on the other 
hand, depend more on social policy decisions concerning the custodial 
functions of schools — the length of time students e^re reqtiired to spend 
there — than they do on technological variations within the schools 



A 45-15 plan is a scheme for .year-round school attendance. "This plan 
calls for each of four student groups to spend nine weeks (45 days) in 
"school, four times a year, with three-week (15-d&y.^ vacations between 
in-school seskjons. This means that, at any one time, only three of 
the four student groups f.re in school'' (Ref. 36, p. 5). 

year-around operation can also reduce by t.lmost 25 percent the equip- 
ment costs of most of the technologies examined. 
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IV UTILIZATION OF EDUCATIONAL TECHNOLOGY 

The basic goal of our vork in utilization is to understand how various 
technologies are used in publ ,c elementary and secondary schools by 
analyzing data on what hardwaie and software is now in place^ and by 
analyzing the patterns of Its use in the past^ in the present^ and In 
the future. We have used a study conducted in the early 1960s as a 
benchmark. This study ^ by Eleanor Godfrey^ is the latest 'comprehensive 
survey of public^ elmentary^ and secondary school utilization of tech- 
nology.^ The conclusions suggest that^ although technology was relatively 
plentiful in most schools^ it was used infrequently and almost always at 
additional cost. We presume^ therefore^ that there 1^ no urgent need to 
review empirical evidence on utilization before the Godfrey study. 

As a supplement to the available literature on utilization^ we did 
a limited resurvey based on the Godfrey «tudy,* To this end we revisited 
ten school districts that were included in the earlier study end asked 
several of the same questions^ as well as others^ in the light of the 
new technologies* The original survey included: 

• An inventory.^of equipment and materials. 

• Patterns of utilization of equipment and materials* 

• The climate of opinion of schbol personnel concerning tech- 
nology. 

• Changes in inventories from; 1981 to 1963 and projections 
into th^^-fffture. 

The SRI resurvey covered most of these i3sues and in addition covered: 

• The present potential of the new technologies (e.g., com- 
puters^ cable TV). 

• New development in old technologies (e.g.^ cassette tape 
recorders, 8mm projectors). 



Append i3t C is a separat3 de«;ai led report on the resurvey prepared by 
Eleanor Godfrey. The main points of her report are included in this 
section. 
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• The potential of technology in an era of accountabil;! ty and 
financial stress* 

At the tine of the Godfrey Study in 1961-63, there was a fairly / 
standard stable of workhorse technology, which included the 16mm projector, 
slide-filmstrip projector, record players, and tape recorders. These 
devices were quite generally available, even in small districts, although 
the materials to use on the devices wore often difficult to obtain and of 
poor qualify and quantity. Godfrey concluded that the technologies were 
used infrequently and almost always as "add-'Ons"' at extra cost. However, 
there wac general verbal acceptance of the idea of educational technology. 
Godfrey concluded therefore that the technical or machinery problem was 
closer to solution than the instructional problem for each grade and for 
each subject. Godfrey also concluded that the critical eleuient in 
utilization is the teacher. Our society places high premium on autonomy. 
If the technology is not compatible with the teacher*© philosophy, it 
will not be used. Godfrey said that in the early sixties the teacher 
was unconvinced. 

The evidence is not available to make such unequivocal statements 
about utiL^zation today. While all of the districts we talked to had 
increased tneir inventories, the patterns of utilization do not seem to 
have changed greatly over the decade since the Godfrey study. There was 
a notable decrease in the variability among large and small districts in 
the type and amount of media and materials in their inventories; the 
small districts now tend to have the same range of equipment as the large 
ones. 

The inventories of all equipment except radios increased In the 
ijchools we resurveyed. The individual filmstrip projector came into 
common use. Very few of these single purpose machines were reported in 
the 1963 national survey. By 1973, however, the ten di;atrtcts we re- 
visited reported over 1,700 units, or enough to provide, on the average, 
one for every 1.6 teachers. Also, the overhead projector grew very 
rapidly and virtually replaced the opaque projector. Ten years ago the 
work horses of educational technology were the record player, 16mm 
projector, slide-filmstrip projector, and tape recorder. In 1973, the 
individual filmstrip viewer and overhead projector had Joined this stable. 

^■ 

The newer technologies have been unex'en in their growth since the 
early sixties. In 1960 the language laboratory was considered a glamorous 
innovation, and 45 percent of the districts in the first study planned to 
develop t^ie use of this medium in the next few years. In 1973 enthusiasm 
for the language laboratory had declined drastically; no one interviewed 
wa>( at all optimistic about its educational potential. 
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Another inflexible system, the teaching machine, has apparently met 
a similar fate. 

Broadcast educational television was in its infancy in 1961. Today 
our respondents in the resurvey uniformly complained of poor reception, 
inadequate programming, inflexible scheduling. Yet five of the eleven 
districts plan to increase their use of television. This seeming con- 
tradiction is resolved when we look at how the medium is used. Direct 
broadcast television is still the unchallenged instant medium for events 
of national or local significance, and the increasing availability of 
cable hookups makes local reception less problematic. But the most 
promising future for television seems to lie in its adaptability for 
local production through the use of videotape. Quality programs can be 
taped off the airland can be used at the teacher's convenience, although 
copyright problems are beginning to loom large. The increasing portability 
of television equipment and the use of erasable tapes makes for a very 
flexible system. Seven of the eleven districts have used video tape 
recording eqvdpment, and all are enthusiastic about tho potential of 
such use in the future. 

A recent survey by NCES of the Office of Education^® showed apparently 
remarkable television coverage in public elementary and secondary schools- 
A' few results: 

• Eighty--two percent of all students are in schools having TV 
receivers. 

• Ninety percent of public schools in large cities have TV 
television receivers. 

• In suburban areas around large cities, about 50 percent of 
secondary schools have videotape recorders. 

• Only 13 percent of the schools have neither of these forms 
of TV. 

• More than 70 percent of schools having TV receivers use 
educational TV. 

• However, only a few schools have enough receivers to permit 
simultaneous use of TV by different classes — the median 
number of receivers is 2.8 per school. , This is a very 
serious limitation. Large scale use of educational TV 
in the classroom awaits the acquisition by the schools 
of large numbers of receivers. 
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It should be observed that the data in the NCES survey was a simple audit 
of TV equipment. It is dangerous to draw conclusions concerning usage 
of equipment from these data» Some of the experts who reviewed this 
report in draft were critical of the NCES survey and concerned that mis- 
le iding inferences concerning utilization would be made. 

The data from our small resurvey indicate that computers are used 
mainly as an administrative tool rather than as a medium of instruction. 
More light is shed on this by a recent national survey sponsored by NSFf''' 
which is consistent with our own data. 

The NSF study, based on a national sample of secondary schools, shows 
that computers are used for instructional purposes by about 13 percent 
of secondary schools. The bulk of instructional usage (about two-thirds) 
is for electronic data processing training and for math course problem 
solving. It should be noted that this study is about four years old. 
There are indications that there have been substantial increases in com- 
puter assisted instruction (CAI) since then. 

Direct CAI applications were much less frequent, about 20 percent 
of the schools making instructional use of the computer. The study 
reaches three major conclusions: 

(1) Use of the computer for instructional purposes is growing 
rapidly. 

(2) Schools must share information or there will be too much 
repetition of costly mistakes. 

(3) Evaluations should be made of experiments so future 
applications can be based on a cumulative experience. ^ 

The climate of opinion in 1973 is much the same as in the early 
sixties. The teacher is primary and essential. Educational technology 
wisely used could improve the quality of education, but only at extra 
cost. In a budget squeeze, administrators contacted in our resurvey said 
technology would be one of the first things to go. The first cut would 
be new equipment, next media center staff and materials, and next new 
programs such as cable television or CAI. 

In the early sixties Godfrey wrote that "educators at all levels 
encounter problems that hamper the effective use of audiovisual materit>ls. 
There is never enough money; projection conditions are far from ideal; 
films do not arrive on schedule; some teachers fail to see the value of 
''SuHiovisual technology; or the added burden of preparing materials for 
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classroom use is just too much to fit into an already crowded schedule" 
(Ref. 2y p. 67). According to our respondents on the resurvey these 
problems still plague the local district. Compounding the situation today 
are the more frequent breakdown of sophisticated equipment, lack of local 
production facilities, lack of technical expertise, and the possibility 
of copyright infringement in reproducing material locally. Apparently 
things have not changed very muc^ since the early 1960s. However, the 
resurvey identified several trends which, if confirmed by a full scale 
study, have important policy implications; 

• The apparent turning away from complicated^ prepackaged 
systems in favor of simple devices suited for local pro- 
duction and student manipulation. 

• The emphasis on individualized media tailored to the in- 
structional needs of a group of students seen as heterogeneous 
in talents, interests, and knowledge, rather than as a "fourth 
grade" of "freshman English class." ^ 

• A counter trend toward accountability for the achievement of 
some minimum standard of proficiency by all, or nearly all of 
a class. 

• The trend toward individual school autonomy in curriculum 
and budgeting. This decentralization, coupled with rising 
taxpayer resistance to continually rising school costs^ 
despite declining enrollments, does not presage a receptive 
climate for the rapid development of sophisticated tech- 
nology. Even with massive outside support, such development 
might be counter to the educational mission as seen at the 
local level. 



• The extension ^f the concept of autonomy in the teacher's 
demand to be recognised as a professional capable of 
directing his own work, without interference from district, 
state, or federal administrative personnel. Almost all of 
the respondents alluded to the final decision making power 
of the teacher in whether and how educational technology 
will be used* You can "make the bait aval labile, " but 
whether or not it is accepted^irs up to the individual 
teacher. 

We repeat that the evidence on present day utilization is scarce. 
A systematic large-scale study of utilization along the lines of the 
early Godfrey study is needed in order to permit accurate estimates of 
current utilization and of changes since that, Study. We strongly rec- 
ommend that such a study be conductfed. Federal technology policy designed 
to aid public schools will almost certainly be flawed without such up- 
to-date information. . ^ 
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V INVENTORY OF FEDERAL ACTIVITIES AND EXPENDITURES IN 
EDUCATIONAL TECHNOLOGY RESEARCH AND DEVELOBIENT* 



Introduction 

One of the early efforts on this project was an inventoi7 of recent 
(fiscal years 1971 and 1972) federal R&D activities in educational tech- 
nology, t This information provides a backdrop for the analysis of forward 
looking federal policy, since past R&D activities reflect implicit or 
explicit strategies and ^phases* Of course, it is evident that much 
federal activity is in response to a wide variety of influences (legisla- 
tion, pressure from constituencies, and so on). and does not necessarily, 
or even probably, reflect calculated programmatic R&D strategies. None- 
theless, patterns of R&D do indeed amount to a federal policy, intentional 
or not. 



For this inventory we relied primarily on the information services 
of the various agencies concerned with educational technology. In our 
initial analysis of Smithsonian Science Information Exchange tr^aterial 
we discovered that by far the bulk of the R&D activity < educational 
technology was carried out by three agencies: the Nati Science 
Foundation, the Office of Education, and the Department _ Defense (see 
Appendix D) . Our analysis is limited to these three agencies. We think 
we have a reasonably good picture of the R&D activities of these three 
agencies which, when aggregated, reflect to a reasonable extent the ac- 
tivities of the government as a whole. 

Appendix D contains a detailed descrijition of the methodology and 
procedures used in conducting the inventor^lj. This methodolciify will be 
oommarized here in order to provide perspective for the analysis of 
findings and conclusions to follow. 



Appendix D contains a detailed description of the methodology of the 
R&D inventory • 

The inventory was limited to R&D funded by ''discretionary" federal money. 
This eliminates R&D fiinding allocated on a block grant basis, 
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0£ and DoD have computerized systems that accept detailed lists of 
descriptors or key words and produce output list of ongoing projects 
tagged with those descriptors. (These descriptors are listed in 
Appendix D.) In a very real sense^ then, the information on R&D activities 
is conditioned by the descriptors^ whlc^j^re largely oriented to instruc- 
tional devices or materials* 

For the 0£ we used the Projects and Grants Information System (PGIS)^ 
for DoD the Defense Documentation Centner (DDC), and for NSF the annual 
NSF publication listing grants and awards. We performed checks of com- 
pleteness and accuracy for each of their sources (these checks are re- 
ported in more detail In Appendix D) . In the case of PGIS, fairly 
careful checks (in two bureaus) indicated the coverage of KM) projects 
was about 80 percent complete « Our best information from DDC indicated 
that its coverage is at least this Complete. The NSF data (which is not 
computerized) is reasonably complete also. 

A word is in order concerning our experience with these computerized 
systems. These systems may be useful tor eame purposes^ but they have 
serious drawbacks as sources for inventories of educational RAD. Some 
of these drawbacks are noted here for the benefit of future user3 of 
this t e of information system* 

First, the data obtained frcm the computerized systems must be care- 
fully checked. Such checks inevitably reveal errors, inconsistencies, 
incompleteness, or all of these. In such cases, another pass through a 
system may be necessary. In our project, several paeses were required* 
In some cases this led to very long waits— our record on some of these 
experiences is very nearly a chronicle of despair. 

Second, each information system has a somewhat different method of 
obtaining the stored information* Key words and descriptors are not 
interchangeable. Hence, entry into each system is unique. This leads, 
of course, to uncertainties concerning the comparability of data between 
information systans, which can only be resolved by independent checks* 

Third, the information systems are not kept up-to-date. £ach RkD 
project is, in some sense, imique and, typically, goes through a ccnnplex 
evolution* As a project nears the contractual stage, changes can be 
made in problem, scope, approach, timing, and funding; similar changes 
can be made after the contract is signed. These changes, if reported, 
find their way into the system sooner or later. 
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In trying to cope with these and other problems^ we arrived at the 
conclusion that computerized information systems are not suitable for 
inventory studies like ours. Our experience suggests that telephone 
surveys of principal investigators or project leaders may be the most 
effective and inexpensive means of collecting Inventory data (assuming 
a complete list of such persons is available) . Such persons seem de- 
lighted to discuss their work. They are almost always locatable^ though 
in some cases it is necessary to make several calls. And most importantly^ 
data from the investigator is probably more valid and reliable than from 
the computerized information systems. This is particularly important on 
the duration and funding of research, which are highly variable over time. 

Findings 

Over $44 million was invested -^^n educational teclinology R&D for the 
two fiscal years 1971 and 1972. The NSF contribution was largest, at 
over $17 million. DoD and OE added $15 million and $12 million respec- 
tively. This represents about 20 percent of the total federal investment 
in educational R&D for the same period (about $240 million). Our guess 
is that $44 million is probably an underestimate of the amount spent on 
technology, since the inaccuracies found thus far show that we are more 
liable to miss projects than include inappropriate ones^ 

What did the three agencies do with this R&D money? NSF's main 
activity was K&D in computers in education.* Nearly $9 million, or about 
50 percent of the total, was spent on computer based instruction. (This 
includes a variety of computer projects.) 

Nearly another quarter of the total, about $4 million, was invested 
in networks of university based groups to study the applications of com- 
puters to instruction. Typically, these networks included a large number 
of institutions of higher education, led by a few universities or ?.olleges 
with special computer expertise and hardware. The networks are designed 
to provide leadership, inspiration, and guidance from centers of excellence 
to a regional or state group of smaller colleges and universities. 



The information on NSF*s R&D is derived from the annual report on con- 
tracts and grants. This report simply lists the investigator, title of 
proj^ict, and level of funding. 
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NSF*s remaining investments (over $3 million) wore devoted to a 
variety ot technologies^ over ten percent, or nearly $2 million, of 
which was in films. The remaining Investments, all under $0.5 million, 
ranged'^ over ETV, programmed instruction^ simulation and gaming, and so 

on. \ 

\ 
\ 

NSy relies largely on universities to perform its R&D, which is 
oriente<^ primarily to a normal population. Little else can be said about 
NSF due \to the ocanty amount of information on each R&D project. More 
complete^ data is available for DoD and 0£, 

\ ■ ■ ■ 

The following analysis of DoD and 0£ activities is based on these 
variables^:* 

• Type of t€»chnology. 

• Type of project (e.g., development, evaluation, 
demonstration) • 

• Target audience, 

• Performer of R&D. 

• Grade level. 

• Public law (for OE only). ^ 

Doi; presents a different pattern of activit;J.es, on which it spent 
a total of nearly $13 million. Almost $6.5 million, or over 40 percent, 
was devoted to simulation and gaming. The primary focus of this type 
of R&D was on devices and procedures for military training designed 
primarily to avoid direct use of actual equiinnent. These projects ranged 
from very large simulations of nuclear war to sm^all arms combat situations. 
About $3.75 million, or 25 percent of the total DoD funds, went into CAI. 
Two million dollars was devoted tb multimedia systems. The remaining 
funds, all under four percent of the total DoD R&D funds went to ETV, 
films, programmed instruction, recorders, and the like. 

DoD R&D was heavily oriented to development type projects— over 
75 percent ($11.5 million) was devoted to this type of activity. Research 
(11.8 percent) and evaluation (11.8 percent) made up the remaining ac- 
tivities of significance. None of the other types of projects (d^on- 
stration and literature review) exceeded one percent of the total. 



See Appendix D for a detailed description of the variables. 
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The DoD target audience was overwhelmingly normal (i.e., not handi- 
capped, mentally retarded, or the like) — 99.1 percent, a pattern BoD has 
in common with NSF but, as we shall point out, quite different from OE. 

DoD performs nearly 60 percent of its R&D in DoD Installations. 
Universities (17.2 percent), private profit making companies (16.6 per- 
cent), and private nonprofit organizations are the other frequent per- 
formers . 

All of the DoD R&D is focused on the' postsecondary grade level, as 
might be expected of a military organization with a total population of 
adults* 

The Office of Education pattern of R&D activity diffei*s substantially 
from DoD and NSF. Whereas DoD and NSF were focused narrowly, OE is much 
more diversified and clearly less concerned with computers. Multimedia 
Systems is OE's single biggest commitment— almost $3 millibh, or nearly 
one-quarter of its total budget. This activity entails the use of two 
or more media (including computers) for specific instructional purposes, 
whore the various el^nents are conceived as a system of instxxiction. OE 
is also the biggest federal investor in ETV, which took nearly $1.5 
nillion (11.5 percent) of the total OE budget. ^ ^ 

OE has a significant amount devoted to computers — over 18 percent 
($2.3 million) to CAI and over 6.0 percent (about $0.75 million) devoted 
to the noninstructional use of computers. The projects involved include 
pure CAI development as well as the use of computers for the direct and , 
indirect support of instruction. 

As with DoD and NSF, OE has small investments in a variety of tech- 
nologies. These include programmed Instruction, film, recorders, radio, 
and the like. The total amounts for each of these are all under $0.5 
million for the two year period. 

OE devotes over 50 percent ' of its R&D to development-type R&D. Other 
R&D orientations of significance are demonstrations (^bout 20 percent), 
research (8.9 percent), literature review (7 per'cent), and evaluation 
(5.9 i>ercent). The remainder are "miscellaneous** or "not applicable." 

Performers of OE's R&D are highly diversified compared to DoD and 
NSF. About a third of the projects are performed by universities and a 
third by public schools. Nonprofits (15.5 percent) and private profits 
(8.8 percent) account for nearly all the remaining performers. 
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OE, in contrast to DoD, has a widely varied target audience^ with 
normal being the largest (31.4 percent); bilingual (24.5 percent)^ 
handicapped (22.9 percent)^ disadvantaged (6.4 percent)^ and retarded 
(0.6 percent) account for the remaining target audiences. (14.2 percent 
were "miscellaneous*' or not applicable.) 

In terms of grade level, OE devotes 34 percent to the postsecondary 
levels in sharp contrast to DoD and NSF^ both' of which devote nearly 100 
percent to this level. 0£ has 25 percent directed to eLementajry grades^ 
9 percent to getleral audiences (all levels)^ over 8 percent to preschool^ 
5 percent to combined elementary and secondary^ and 2.^8 percent to sec- 
ondary levels. '^Miscellaneous" and "not applicable" make up the remainder. 

\^ 0£ R&D activities are funded under various pieces of legislatioh. 
Prominent among them are the Elementary and Secondary Education Act 
(54.5^ percent). Cooperative Research (24.4 percent). Higher Education 
Act (il.8 percent), and National Defense Education Act (4.2 percent) • 
A variety of '.egiialation accounts for the remainder, which is under one- 



Conclusions^ 

One of the i^iost clearcut patterns emerging from the inventory is the 
high level of investment in the "newer" technologies; For NSF, DoD, and 
0£ aggregated, 76.8 percent (almost 35 million) is devoted to such tech- . 
nologies as computex1», television, simulation and games, and multimedia 
systems. In DoD the newer technologies account foi* 84 percent, in NSF 
over 80 percent (all biit a fraction in computers), and in Oi3 over 60 per- 
cent. This is imp3:ressive evidence of ^ broad federal tendency to stress 
R&D on the newer aspects of the field. 

It is not possible to say definitively whether or not this emphasis 
on the newer technologies is appropriate, or if more or less R&D funds 
should be so invested. Certainly one of the important federal roles in 
technology is to do pioneering R&D" that is too risky for, or beyond the 
resources of, the private sector or of state and local govejmments. In 
this sense it se^s reasonable that a high proportion of federal R&D 
funds be devoted to newer aspects of the field. 

R&D on the newer technologies varies substantially between the three 
agencies. NSF*s stress on computers is of long standing. NSF is recognized 
as one of the centers that consistently pushes the computer based instruc- 
tion state-of-the-art. While its R&D budget for computer based instruction 
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has been declining in recent years^ NSF will no doubt continue to be 
highly influential. NSF is moving out of operational support and more 
into advanced systems.* The PLATO (programaed logic for automatic 
teaching operations) system is an example of this trend as is the TICCIT 
System (time-shared "interactive computer-controlled information system) . 
Both of these are advanced systems using computer based instruction. 
NSF is currently evaluating both systems. 

DoD is heavily invested in R&D on simulation and gaming (over 40 per- 
cent). This is clearlV-a-<«ilitary training issue where the simulation 
affords savings of money, trainee time, and wear and tear on actual 
equipment. DoD also has significant R&D activities in CAI and in multi- 
media systems; some of the CAI work now underway at Fort Monmouth is 
highly advanced. 

The OE R&D investments in the newer technologies center around multi- 
media systems (23.1 percent), CAI (18.1 percent), and ETV (11.5 percent). 
OE also has very large investments in operational support of ETV. For 
example, in fiscal years 1971 and 1972 OE invested over $8 million on 
ETV operations, a large proportion of which went to the well known 
Sesame Street and Electric Company. While this support is currently 
rapidly declining, OE has gained important experience "* > supporting the 
creation of high quality instructional TV for mass u&vd. 



Personal communication from Dr. Andrew Alolnar of NSF. 



VI SUMMARY, IMPLICATIONS, AND RECOMMENDATIONS 

In each of the prei:;edlng sections we have examined the evidence on 
the four key questions that we -set out to answer. In this section we 
attempt to answer the question, "What does all of this mean?" and, more 
specifically, "What implications does this have for federal policy?" 
Let us first quickly review the conclusions of each of the sections. In 
brief, the answers to each of the four questions were: 

(1) How is educational technology used in public elementary 
and secondary schools? 

Educational technology is used for the most part as an 
addition to, rather than as an Integral part of the 
instructional process, and is almost always an added 
cost to instruction. Also, high quality up-to-datfe 
software is not always available, and local production 
is expensive and time consuming. 

(2) How effective is educational technology? 

Virtually all of the educational research on the 
effectiveness of technology in education finds that 
tecl;uiology is not significantly more or less effective 
than conventional instruction. Generally, technology 
that is wisely used is effective for almost any in- 
structional task. 

(3) How much does educational technology cost? 

Adding technology to the present program of a school can 
cost anywhere from $0.05 per student-hour (for printed 
programmed instruction) to $4.00 per student-hour (for 
computer assisted instruction). With present knowledge, 
even a zero-cost technology might save a school system 
at most 11 percent of the total budget, and current uses 
of technologies would save considerably less, if anything 
at all. Other less capital-intenbive means of reducing 
costs appear more attractive than technology. 
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(4) What have been the federal activities in the field in the 
recent pa^t (fiscal 1971 and 1972)? 



The three federal agencies primarily involved in the field 
are DoD^ NSF, and 0£» Most of the federal dollars have 
gone into R&D on television based instruction^ computer 
based instruction^ and siiuulation. NSF has invested 
heavily in computer based instruction. DcD has a heavy 
investment in simulation* 0£ invests in a wide range 
of technologies and forms of support^ with the largest 
amount going to multimedia systems. 

How does all of this divers^ evidence coirpare with the claius being 
made for educational technology? Table 2 is a short list of some of those 
claims and of the evidence coaceming them that we have accvimulated. 



Table 2 



CLAIMS FOR EDUCATIONAL TECHNOLOGY 



Claim 



Count ^r Evidence 



Technology can radically reduce the 
cost of education. 



Technology can dramatically in- 
crease the effectiveness of edu- 
cation* 

Technology can replace the 
teacher* 



Technology^ at least in uses cur- 
rently suggested for It^ can 
theoretit:alIy save at most II 
percent of the total school bud*- 
getj and probably less* In no 
actii'al case has technology alone 
reduced the cost of education* 

The effectiveness of technology 
has not been shown to be sig- 
nificantly different from that 
of conventional instruction. 

Xliile some redeployment of 
teachers has accompanied ,the use 
of technology^ any. significant 
replac^ent of teachers in public 
elementary and secondary schools 
is still a long time in the 
future* , Currently^ technology 
requires more teachers * 
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Given these doubtful claims^ what can we say about the role that 
technology can, does, and will play in public elementary and secondary 
education? There are some functions that technology has traditionally 
performed, and which evidence suggests it can perform effectively; these 
include:. 

• Bringing to the limited classroom environment the sights and 
sounds of the world outside of the classroom. Research shoves 
that a picture is indeed worth a thousand words in making 
some points; subjects such as art and music are taughx mucl} 
more effectively with thb aid of audiovisuals. 

• Bringing formal education to an audience that would not 
otherwise have access to it. The great usefulness and 
cost-effectiveness of technology in reaching people that 
would not dotherwise be students has been demonstrated by 
such institutions as Britain's Open University and 
Australia's correspondence schools that use radio. 

• Making^ available programs of study that are tailored to 
the learning speed and sometimes the learning style of an 
individual. Reading laboratories have been used veiy 
effectively to tailor the speed of progression through a 
reading sequence to the abilities of the individual. 

• Adding subjects to the curriculum for which specialized 
teachevs are not available. Technology can present a 
sequence of lessons on any topic, so that any teacher 
can presen Ihem. 

• Saving time. Some technologies, notably programmed in- 
struction and computer assisted instruction, have demon- 
strated significant time saving over conventional 
instruction. 

• Teaching students about technology. Technology has been 
shown to be effective in teaching about technology. For 
instance, computer assisted instruction has been shown 
to be very effective in teaching computer programming. 

These are some of the functions that our study showed technology can 
and does perform effectively. However, our study was limited to the core 
curriculum of elementary and secondary education. Some of the research 
that we examined suggests that the most fioiitful applications for tech- 
nology lie outside of this area. 
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We now turn to the policy recommendations emerging from our analyses. 
We have been careful to formulate these rocommendatione with xae perspec- 
tive provided by other studies In the field. The 1970 report of the 
Commission on Instructional Technology^ is the most important recent 
attempt to analyze c.he federal role in instructional technology. The 
Ccxnmisslon concluded that technology had an important contribution to 
make in education wh^ch was not being currently realised. It made a 
series of recommendetions designed to lead to more effective use of tech- 
nology. These were oriented primarily to massive support of research^ 
development^ and demonstration^ and seem to have been overtaken by re- 
ductions in federal RM) support in education. Only one of the Gommisslon's 
six recommendations has been Implemented— the creation of the National 
Institute of Education."^ 

Our recommendations, listed below, differ from those of the Com- 
mission, Whereas the Commission was primarily concerned with R&D mech- 
anisms, our concern is with substantive policy reccxomendatlons that can 
be addressed immediately by the Education Division cf HEW, 

(1) Claims about the power of tachaolog^y to reform and improve 
public elementary and secondary education should be mod*- 
erated and. brought into accord with the limited knowledge 
of the subject. 

9 

(2) Initiatives taken by the Education Division should be 
formulated in the light of other federal activities. 
Investments in computer applications are an important 
case in point . Both DoD andi NSF have made important 
gains in computer based instruction which should be 
built upon. 

(3) The information about federal R&D projects in education 

is inadequate. Since this type of information is essential 
to policy evaluation end reformvlation, steps should be 
taken to improve the appropriate federal inforiB%tlon sys*** 
tems. The Project and Grants Infoxmction Syste/m (PGIS) 
is the Education Division's Computerized information sys- 
tem. This system is apparently Inadequately financed 
and lacks the authority to obtain inputs from all sources. 

(4) There is no recent systematic infoimation concerning 
atllizatlon of technology in public schools* Since 
cohero'Jit federal policy should depend heavily on such 
information, a utilization survey along tne general lines 
of the Godfrey Study^ of the early 1960s is a high 
priority. 



Personal communication from Br^ Sidney Tickton. 
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(5) There is a need for some form of consumer (i.e., teacher) v 
information on available materials (films in particular). 
Information is needed that would enable a-uee-r: to identify 



along with an evaluation of effectiveness. The Educational 
Products Information Exchange (EPIE) has made a valuable 
start in this direction for hardware. The Education Di- 
vision should explore the dimensions of the demand for this 
type of information for software and means of supplying it. 

A related problem is that hardware is often of poor quality 
and durability. Incompatibility is more the rule than the 
exception. The Education Division should analyze the inter- 
action between the technology industries and public edu- 
cation with a view to encouraging improved quality and 
standardization. Examination of the incentives for in- 
dustry to improve products and services seems a particularly 
high priority issue. 

(6) Education Division technology R&D expenditures were tar- 
geted mostly on "normal" populations in both fiscal years 
1971 and 1972. This is inconsistent with the broad mandate 
for emphasis on the "disadvantaged" at the federal level. 
Analyses of these expenditures should be made to determine 
whether heavier investments in technology for special 
problem areas^ especially the disadvantaged, are appropriate. 

(7) Education Division policy should stress technology for 
special applications and not as a substitute for con- 
ventional instruction. There are a number of promising 
areas of special applications. These include: 

• Intensive instruction for the disadvantaged 

• Technology for higher education 

• New opportunities in adult and continuing education • 

There is not a sufficient basis in knowledge and ex- 
perience to permit the development of an integrated 
federal policy on such special applications. The 
Education Division should explore these applications 
with a view to conducting policy analyses. 
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Appendix A, Part 1 



AN EVALUATION OF THE EFFECTIVENESS 
OF INSTRUCTIONAL TECHNOLOGY 



Introduction 

The emphasis in this discussion on the effectiveness of instruc- 
tional technology is on the use of four different media forms: radio, 
television, programmed instruction, and computer fissisted instruction* 
These technologies have been widely used in many countries at all educa- 
tional levels, including the use for continuing education. Useful infor- 
mation may be obtained from studies of all educational levels, but the 
major concentration will be on the use of technology for primary and 
secondary education in the United States. The research in this field 
has been voluminous, and the conclusions discussed in this paper will 
draw heavily on the conclusions of many surveys of this literature and 
some selected studies. 

To determine the cognitive effectiveness of instructional technology, 
comparisons are usually made with conventional instruction. Unfortunately, 
there is no clear definition of the components of conventional instruc- 
tion. It is also difficult to specify precise experimental controls for 
the studies. For example, in a comparison of televised instruction, 
should we use the same instructor with the same materials in both media? 
Or, should we allow total flexibility in course construction in order to 
utilize the differences in the media? As a broad overview of the effects 
of the various media on cognitive measures, one is struck with a general 
finding of "no significant differences.** Or, as Chu and Schramm (1967)* 
have stated: 

Given favorable conditions, pupils can learn from any instruc- 
tional media now available. 

What are some of these favorable conditions? Armsey and Dahl (1973) 
stressed organizational variables to help insure the isuccess of a tech- 
nology project. These organizational objectives include: the existence 



* 

References are listed at the end of Part 1 of this Appendix. 
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of a recognized and generally agreed upon need and the desire to meet the 
need through the use of technology, the participation and support of 
teachers in the project, and adequate resources for the duration of the 
project . 

The project must also be analyzed to determine the best form of 
technology to use and the manner in which to use it. Forsythe (1970) 
mentioned a highly successful creative arts program that was originally 
broadcast on radio and later transferred to television. The program was 
returned to radio when it was discovered that its effectiveness had 
diminished, since students were copying the artist. Chu and Schramm 
(1967) concluded: 

The use of visual images will improve learning of manual tasks, 
as well as other learning where visual images can facilitate 
the association process. Otherwise, visual Images may cause 
distraction and interfere with learning. 

It is possible that the technologies must be adaptable to particular 
abilities, knowledge bases, or personalities of the students. There is 
little evidence in the literature to draw any firm conclusions on this 
basis. The one possible exception is the high degree of success of 
computer assisted instruction for compensatory education (e.g., Wells, 
Whelchel, and Jamison). 

One might feel that a successful use of technology would take advan- 
tage of the unique capabilities of the various media (e.g., color tele- 
vision, animation). Chu and Schramm analyzed a variety of program formats 
for instructional television and generally concluded that 

. . . effective use of television grows out of attention to the 
basic requirements of good teaching, rather than to any 
fanciness that might be peculiar to television. 

Chu and Schramm also suggest that good use of television depends, like all 
instruction, on 

... qualities like simplicity, good organization, motivation, 
practice, knowledge of results, rest pauses at appropriate 
points, cues that direct the pupil to the essential things he 
is to learn. 

These general considerations can probably be applied to the other media 
forms. 
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However, this does not mean that there are no unique advantages 
to the use of technologies. Radio and television can extend schooling 
to areas that receive no schooling and can provide a wide variety of 
auditory and visual experiences and demonstrations that might otherwise 
be unavailable. Programmed and computer assisted instruction allow for 
scheduling flexibility and individuality in progression to specified 
goals. Several studies have demonstrated the savings in time resulting 
from programmed and computer assisted instruction, even when there are 
no significant differences in cognitive performance on a comparison with 
conventional instruction. 

Time is a scarce economic resource, and the possibility of time 
savings should be considered in an anlysis of the relative effectiveness 
of the media. The analysis of the costs of the instructional technolo- 
gies is an obvious part of the process of assessing the relative effec- 
tiveness of the technologies. 

The attitudes of students and teachers toward the various media seem 
to be favorable. Although as Dubin and Hedley {19«j9) found, the students 
are more interested in the quality of instruction rather than in the form 
of instruction. They found that college students tended to prefer small 
discussion classes to television classes, and television classes to large 
lecture classes. Dubin and Hedley also concluded that the students would 
choose a televised course with the guarantee of a superior instructor 
rather than face the uncertainties in registering for a conventional 



Zoll (1969) and Schramm (1962a) reported that students were f^enerally 
favorable to programmed instruction, although they became bored w:.th long 
programs and programs that continually used short steps. 



The Wisconsin Research Project in School Broadcasting (1942) did not 
find any differences in interest or appreciation of students who received 
a course over radio and students who received the course without radio. 
However, the investigators did find significant effects on social attitude 
changes in a curriculum on community living, Willis (1940) also uncovered 
significant changes in attitudes of high school and college students as a 
result of short (15 minute) radio programs. 

Wells, Whelchel, and Jamison did not find any differences in self- 
expectation between students who received computer assisted instruction 
(CAI) and students who did not, although they did uncover an association 
between self-expectation and Increased CAI use. Smith and Hess (1972) 
used a variety of measures of student attitudes and could find no differ- 
ences between CAI and non-CAI groups* 
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The most interesting study of attitudes of CAI students was under- 
taken by Hess and Tenezakls (1970)* They attempted to measure the stu- 
dents* attitudes toward the computer and the classroom teacher to assess 
the use of the computer as a socializing agent. The students seemed to 
have realistic attitudes etbout the capabilities of the computer. They 
felt that the computer had more expertise than the teacher and would be 
more neutral in evaluating the students. They also felt that the computer 
was more responsive to student abilities but less responsive to student 
desires. 

The four media forms are discussed separately in the next four sec- 
tions. In each section there is an attempt to assess the effects of the 
media on cognitive outputs, effects of alternative program formats, and 
changes in student social attitudes and attitudes toward the media* The 
section on television also contains a discussion of the evaluation of 
Sesame Street. This well publicized project has attracted vociferous 
acclaim and criticism. The statistical evidence on one of thr major 
program goals — to increase the readiness of poverty children entering the 
first grade — has been mixed (Ball and Bogatz, 1970; Bogatz and Ball, 
1971; and Sprlgle, 1971, 1972). There is also widespread criticism on 
program content: wrong directions for reading and mathematics readiness 
(Holt, 1971), adult dominated discussions (Sprigle^ 1972), and the lack 
of appropriate learning models (Meichenbaum and Turk, 1972). 

Radio 

Instructional radio has declined in use in the United States since 
the 1930s and *40s« However, radio has not completely disappeared from 
American education; Forsythe (1970) mentions several projects in Portland, 
St. i*ouis, De^ Moines, Newark, and Washington providing compensatory 
education for disadvantaged children. For the St. Louis project, Kottmeyer 
(1970) reported substantial gains in IQ and spelling for students who 
listened to the broadcasts' as a supplement to regular instruction as 
compared to students in previous years who did not hr.ve access to the 
radio programs. 

The attraction of the newer and more glamorous media may have con- 
tributed to the decline in interest in radio in the United States, but the 
effectiveness of instructional radio is amply demonstrated by the wide- 
spread use of radio in many other countries and by the results of the 
early studies in the Hnited States* Forsythe (1970) mentions the use of 
radio in Sweden (166 hours of instruction per yaar to 12^000 participating 
schools), Korea, England, Canada, Cameroon, Sudan, and Nigeria* Jamison, 
Suppes, and TVells discussed the use of radio in England (63 radio series 
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with illustrated pupil pamphlets and coordination between classroom 
and radio teachers), Australia (6^000 students enrolled at the Radio 
University of New South Wales in 1965), Japan (47 percent of the primary 
schools, 37 percent of the lo^er secondary schools, and 27 percent of the 
upper secondary schools used radio in 1958), and Thailand (students re- 
ceived instruction in English, social studies, and music between 1957 
and 1965). Chu and Schramm (1967) mentioned the effectiveness of radio 
in teaching literacy to villagers in Malaya (see Entwisle, 1955), in 
teaching English to elementary school children in Ghana (see) Kinross, 
1961), and in teaching French to elementary school children in Tahiti 
(see Medard, 1962). 

Xoomsai and Ratamangkala (1960) compared radio instruction with con- 
ventional instruction in music for grades two and three and in English for 
grades six and seven in Thailand. For the music lessons, the radio group 
performed significantly better than the control group* The radio groups 
' scored significantly higher irl reading and writing tests for English, but 
did not score higher on the' aural tests". The results on the aural tests 
are surprising^ £3ince one -might expect radio to be advantageous in areas 
requiring only auditory stimulation* 

Examples of Learning from Instructional Radio 

Carpenter (1937) used radio for science for students in the fourth 
through the twelfth grades and found that these students performed as 
well as conventionally taught students. 

Brewer (1939) used radio for teaching science to elementary school 
children and concluded that the radio group performed significantly 
better than the ntfnradlo group and had more favorable attitudes and a 
higher interest in science. 

Miles (1940) also us^d raciio for teaching elementary science and 
concluded that the radio group perfomed significantly Itietter than con- 
ventionally taught students. 

Constantine (1964) in a more recent evaluation of the effectiveness 
of radio for science instruction of elementary school children demon- 
strated a gain of 14 months on a standardized test of science information 
/ and a gain of 15 months in work study skills in one school year (the norm 
gain is 12 months). 

Lumley (1933) investigated the use of radio for high school foreign 
language instruction. The radio students excelled in pronunciation over 
nonradio student s, 
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Wiles (1940) couipared the perfoxmance of Junior high school Btudents 
listening to new? broadcasts with the performance of nonradio students 
and found that the radio students learned more. 

Nelson (1957) found no significant differences in the performance of 
groups listening to an interview program on radio with groups watching che 
interview on television- 
Barrow and Westley (1959) also compared the effectiveness of radio 
and television for news broadcasts* The programs were used for sixth 
^'rade students. The television group performed better on a test of imme- 
diate recall, but there was no difference in a test of retention six 
weeks later. 

The Wisconsin Research Project in School Broadcasting (1942) pro- 
vides one of the more extensive analyses of the use of instructional 
radio. Programs were produced for music, nature studies ;> geography, 
social studies y English, the encouragement of reading gooa books, and 
the improvement of speaking ability. A wide variety of tests were used 
for assessing the performance of the students in 1bhe various programs. 
The music course was the most successful. Radio students scored signifi- 
cantly higher than control groups on several tests of music ability. For 
most of "'^e other courses no 'Significant differences were reported between 
control a. d radio groups. The researchers attributed this negligible 
effect to the possibility that teachers of the control groups were' stimu- 
lated to their best efforts; all teachers had received course out linens and 
lesson materials for the radio courses. Since the radio student^ out- 
performed the control students in music and tended to do better (although 
not significantly) in English and speech, the lesearchers also concluded 
that radio lessons might have an advantage in those areas where auditory 
illustrations were important. 

' <• • » . 

Noncognitive Effects of Instructional Radio 

The report of the Wisconsin Research Prcject also provides useful 
information about student interest, organization, apd attitude change. 
Information on teacher reaction was obtained irom voluntary responses 
to questionnaires (approximately one-third of the teachers responded). 

Generally, there were no oignificaht differences in interest or 
appreciation between r^^dio and control groups for most of th^ courses. 
The most interesting result was the change in stud<*nt attitudes in the 
social studies curriculum. The radio groups had significantly higher 
changes in the direction of the program goals; the goals were to increase 
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(1) Tolerance toward the interests of various economic groups, 

(2) Cooperation with the members of one's own group in solving 
common problems- 

(3) Cooperation with other groups in solving common problems. 

(4) A sense of responsibility in furtheiijv? the interests of 
one's own group. 

In related work on attitude change, a study by Willis (1940) was 
cited- Willis compared the relative effectiveness of three forms of 
radio presentations: straight talk, complete dramatization, and a com- 
bination of talk and dramatization. The subject areas treated were: 
the treatment of criminals, freedom of speech and press, and the atti- 
tudes students should hold toward the German people* An attitude test 
was administered to high school and college students before the program, 
at the conclusion of the program, and after two weeks. There were non- 
listening control groups for each education level. The following general 
conclusions were noted. 

• A 15-minute radio program significantly shifted the atti- 
tudes of high school and college students. 

• The attitude changes were still significant after two weeks, 
although there was more of a tendency for the attitudes of 
the high school students to return to original attitudes- 

• For high school st^idents, the dramatization was most effec- 
tive, the combined form next, and the talk the least 
effective in changing attitudes (all methods produced 
Eij?nificant attitude changes) • 

• For college students all three methods were equally 
effective. 

• In terms of preference the high school students ranked the 
combined form first, the dramatization second, and the 
talk third. College students ranked the combined form 
first, the talk second, and the dramatization third. 

\ 

The use of radio for producing changes in at1?itudes seemr to be 
highly ef^-^ctive. Radio has also been successfully used to inculcate 
socially desired values in Thailand (Jamison, Suppes, and Wells) and 
Korea (Forsythe, 1970). / 

In terms of organization, the Wisconsin Research Project reported 
the following conclusions from the teacher responses. 
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(1) Wisconsin teachers think that all of the programs make 
valuable contributions to school curricula. 

(2) Teachers need less help in teaching fundamental school 
subjects than in teaching enrichment subjects. 

(3) Curriculum content in some schools was affected by the 
radio program. 

(4) Most teachers used the materials supplied for the radio 
programs and found them useful. 

(5) More use should be made of teachers in planning the radio 
programs. 

(6) The use of radio programs for high school subjects 
presented a greater scheduling problem at the high school 
level than at other levels. 

Televised Instruction 



The research into the use of television for educational purposes has 
been voluminous. There have been several excellent surveys of this 
literature (Schramm, 1926; Stickell, 1963; Chu and Schramm, 1967; and 
Dubin and Hedley, 1969) and large scale experiments (Pf lieger and Kelly, 
1961; and Kelley, 1964). This section will draw heavily on the ijesults 
of these studies. The major conclusion that one reaches is that educa- 
tional television is as effective as conventional instruction. 

As Chu and Schramm point out, the advantages of television include: 
the possibility of using a good teacher for many students, the accessi- 
bility of a variety of experiences and demonstrations, the extension of 
schooling to areas that receive no , schooling, and the freeing of time for 
classroom teachers. The disadvantages include: the lack of adequate 
two-way communication and feedback channels, and a difficulty/ in merging 
the television program with regular work. j 

The general conclusions regarding the effectiveness of televised 
instruction as derived from the survey papers will be discussed in the 
next section. This will be followed by (i) a discussion of /some of the 
conclusions reached by Chu and Schramm regarding program fo^at, (2) an 
in-depth discussion of a long-term, extensive local use of /t^levi^ion 
(Hagerstown) and a nationally broadcast educational series (Sesame 
Street), and (3) a brief discussion of some of the conclusions regarding 
student attitudes toward television. 
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The Effectiveness of Educational Television 



Pflieger and Kelly (1961) reported the results of a three year study 
that involved over 200,000 students in 300 public schools. Most of the 
comparisons resulted jn no significant differences; there were signlfi- 
C£.nt differences favoring the TV-taught students in 119 cases and the 
conventionally taught students in 44 cases. 

Kelley (1964) evaluated over 300 matched achievement test comparisons 
from 1956 to 1961. He found significant differences in favor of tele- 
vision in 25 percent of th cases. 

Schramm (1962b) evaluated 393 studies and found no significant dif- 
ff^rences in 255 of the studies, significant differences favoring television 
in 83 cases, and significant differences favoring conventional instruction 
in 55 cases. 

ehu and Schramm (1967) evaluated 207 studies that involved 421 sepa- 
rate comparisons. Of these comparisons there vere no significant differ- 
ences in 308 instances. Significant differences favoring televised 
instruction were found :^n 63 comparison and 50 cases favored conventional 
instruction. 

Stickell (1963) analyzed 250 comparisons. He applied strict re- 
strictions on experimental design and determined that 217 were not inter- 
pretable. Of these 217, significant differences occurred in 59 cases and 
were evenly divided between televised instruction and conventional instruc-' 
tion. Twenty-three studies were only partially acceptable (usui' lly because 
of nonrandom assignment) and of these there were significant differences 
in favor of television in three cases. 

Ten acceptable studies were all undertaken by Carpenter and Greenhill 
(1955, 1958) at Pennsylvania State University and resulted in no signifi- 
cant differencec* The restrictions were: 

• Experimental and control groups consisted of at least 
25 students. 

• The students had been randomly assigned from the same 
population. 

• The students were taught by the same instructors, either by 
two instructors exchanging classes in the middle of the term 
or by seat! \g one group in the room from which the class 
was being televised to the other group. 
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• The results were measured by a testing instrument judged 
to be valid and reliable* 

• The results were evaluated by acceptable statistical 
procedures. 

Dubin and Hedley (1969) surveyed research in college Instruction by 
television. In order to be included in their survey the study (1) had to 
be of an American collef^ course for credit of at least one term duration 
and (2) had to include a report of group mean scores on identical tests 
for students* in a televised course compared with students in a conven- 
tional course. On this basis they found 102 studies that favored tele- 
vised instruction r 89 that favored conventional instruction, and two with 
no significant differences. Dubin and Hedley felt that a more accurate 
conclusion could be obtained by using a ''t-value'^ for the statistical 
comparison of mean scores. Positive values were assigned to '*t-values'* 
that favored televised instruction, and negative values were assigned 
when conventional instruction was favored. The distribution of "t-values" 
was then analyzed to determine if the mean of the distribution was sig- 
nificantly different from zero. Ninety-three studies were included in 
this analysis, and conventional instruction was favored over televised 
instruction. When experiments using two-way television (systems employ- 
ing audio feedback to the television studio) were excluded there were no 
significant differences. 

Dubin and Hedley used this result to conclude that two-way television 
was a particularly poor use of technology. However, in their survey 26 of 
the 26 studies in two-way television came from the same college. This 
might be indicative of poor organization in this particular college rather 
than a deficiency in the use of two-way television. Wolgamuth (1961) found 
no significant differences on attitudes, learning, or retention {after 
four weeks) for college students divided into four groups: (Da studio 
class* (2) a class with talk-back facility, (3) a class that could signal 
for pace of Instruction, and (4) a class with no feedback. Almstead and 
Graf (1960) found two-way televised instruction to be superior for reading 
for 4th and 6th grade students. 

With respect to two-way television, Chu and Schramm (1967) concluded 
that student learning was not impaired by the lack of cwo-way communica- 
tion, although a talk-back facility might be more important for more 
complex subject matter. They also concluded (on the basis of research 
by Cropper and Lumsdaine, 1961, and Cropper, Lumsdaine^ and Shipman, 1961) 
that showing, testing, and revising an Instructional program might help 
substitute for the lack of feedback focilitles. 
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Television was also demonstrated to have a differential impact by 
grade level. Schramm (1962b) and Chu and Schramm (1967) stratified the 
studies in their respective surveys by grade levels. Table A-1 shows 
that television tends to be more effective at lower grade levels. At 
upper grade le.els there is more of a tendency for the finding of "no 
significant difference.'' 



Table A-'l 

COMPARATIVE STUDIES OF TELEVISION INSTRUCTION VERSUS TRADITIONAL 
INSTRUCTION AS A FUNCTION OF GRADE LEVEL 



Grade Level 



Number of Studies 
Showing that TV 
is Superior 



Number of Studies 
Showing that 
Conventiona 1 
Instruction 
is Superior 



Number of Studies 
Showing 
No Significant 
Differen<:^e 



According to 
Schramm (1962b) 

3rd to 6th 
7th to 9th 
10th to 12th 
College 

According to 
Chu and Schramm 
(1967) 

Elementary 
Secondary 
College 
Adults 



50 
18 
12 

3 



10 
24 
22 
7 



16 
5 
21 
13 



4 
16 
28 

2 



86 
28 
57 
84 



50 
82 
152 
24 



Program Format 

The conclusions drawn by Chu and Schramm (1967) regarding program 
format are often based on the results of very few studies. However, 
these results do provide some insight into successful program format. 
Chu and Schramm's numbered conclusions with respect to programming are 
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follow-up, where available, is more effective than a 
second showing of the same program. 

19. There is no clear evidence to suggest whether eye- 
contact in television instruction will affect the 
amount of learning. 

21. The students are likely to acquire the same amount of 
. learning from instructional television whether the mate- 
rials are presented as a lecture, or in an interview, or 
in a panel discussion. 

25. Instructional television appears to be equally effective 
with small and large viewing groups. 

35. Practice, whether by overt or covert response, will 
improve learning from instructional television if the 
practice is appropriate to the learning task, and if 
the practice dofes not constitute an interference* 

36. Note-taking while viewing instructional television is 
likely to Interfere with learning if time for it is not 
provided. 

These conclusions indicate precisely the general findings of Chu 
and Schramm; that effective teaching on television is more a result of 
attention to the basic requirements of good teaching than the use of 
fancy production techniques. Of the numbered conclusions, there seems 
to be an inconsistency between 15 and 35. However, conclusion 15 is 
based on experiments that inserted questions before or after a program 
segment, but did not allow for time for considering responses* The rest 
pause experiments frequently instructed the students to consider the 
facts that were presented (a form of covert response). 

Hagerstown and Sesame Street 

Television has t*<5en in use in the Washington County Schools System 
in Hagerstown, Maryland, for over ten years and 1*^ used for teaching core 
courses at all grade levels. Wade (1967) discussed some of the successes 
of the curriculum as measured by standardized tests. These results indi- 
cate the reasons for the continued use of television in Hagerstown: 

(1) Classes at all elementary grade levels using television 
for mathematics improved. 

(2) Junior high school students in urban schools moved from 
the 31st percentile to the 84th percentile on concepts 
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alter four years of televised instruction. For problem 
solving abilities the increase was from the 33rd percen- 
tile to the 68th. On the same test^ rural students 
moved from the 14th to the 38th percentile on concepts, 
but gained very little in problem solving abilities. 

(3) Significant gains were also reported for 10th grade 
mathematics , 6th grade science, 8th grade science, 
United States history, and 12th grade English. 

Sesame Street was probably the most publicized nationwide experi- 
ment in the use of educational television in many years. As a result of 
the publicity and the large expenditure of funds ($8 million for two 
years from the Carnegie Corporation, the Ford and Markle Foundations, 
Operation Headstart, the Corporation for Public Broadcasting, and the 
U.S. Office of Education) a great deal of analysis and criticism has 
been directed at the programs. Meichenbaura and Turk (1972) reviewed the 
literature on teaching disadvantaged children and suggested several 
methods for improving the programs. Holt (1971) and Sprigle (1971) had 
criticized the program for having the children in a passive learning 
environment and giving children an answer rather than having them figure 
it out. Meichenbaum and Turk concluded from their research that models 
could be used to stimulate attention and scanning activities and to 
influence the manner in which a child would act on his environment. They 
also suggested that children on the program think "out loud" to demon- 
strate the steps by which a problem is solved rather than being given 
answers by adults. 

Holt*s (1971) criticisms were more extensive. He felt that the 
program reinforced the belief that all learning must be deliberately 
taught, and that condescending tones were used to the children. He also 
suggested that the program should emphasize (1) writing as an extension 
of speech and (2) the use and properties of number rather than simply 
counting. 

Rogers (1972) in a summary of literature on Sesame Street also men- 
tioned several criticisms aimed at the noncognitive aspects of the show. 
However, all of the criticism seems to be directed at program content 
rather than the usefulness of television as an educational medium. 

A statistical evaluation of Sesame Street was conducted by Ball and 
Bogatz (1970) for the first year of Sesame Street and by Bogatz and Ball 
(1971) for the second year of production. The evaluations were undertaken 
under the auspices of the Educational Testing Service. The sample for the 
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groups* Comparisons were, again baaed on gain 
ftlf leant differences on six Of tjio items/ the 
gained significantly more ort 13 items aAd had positive 
differences on the remaining ten Items* . 



No signif^^cant differences were uncovered in pretest or gaij^ sj6<ire|; 



for black or white disadvantaged children in each v|efing ciuartl]^^fV -V^ 

The. results also indicated larger, gains for disadyant^iged #iUdet)ta jV. ^r*iAVf 
than advantaged students. Disadvantaged students in the highest viewing 
quartil? had scored lower on the pretest than all viewing quortiled of V 5\; 

advantaged children. Howfevor, on-the posttest these students scored ^ ^ 
higher than the lower two viewing quartiles of advantaged students* 

Sprigle's (1971, 1972) criticism of 9esame Street is on more 
scientific grounds than other crltlcst He conducted several tests to 
determine the abiUties of Sesame Street graduates compared with other 
students* He generally concluded that the programs failed to prepare^ 
poverty children for the first grade and failed ^o narrow the gap in 
achievement between poverty and middle-income children* In his first 
study, he compared the scores on various subtests of the Metropolitan 
Readiness Test and found significant differences favoring middle-tlncome 
children for* each test as compared with children who had watched Sesame 
Street and attended a class where the teacher made use of all materials, 
suggested by the children's Television Workshop (the 1 coordinators of 
Sesame Street). There were no significant differences reported between 
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the Sesame Street students and students who attended a kindergarten 
where Instruction was undertaken in groups of four using the game format 
and where a high emphasis was placed on emotional and social development. 

Sprlgle*s second study was more extensive and equally critical* 
The same groups were compared at the end of the first grade on several 
subtests of the Stanford Achievement Test. As In the first study» there 
were significant differences favoring the middle class children over the 
poverty children who viewed Sesame Street and no significant differences 
between the two groups of poverty children. 

The Metropolitan Readiness Test was again used to compare new groups 
of students; in this instance the experimental groups had viewed Sesame 
Street for two years. There were no significant differences in any of 
the subtests for the students who had viewed Sesame Street for two years 
compared with students in the previous study who had viewed the program 
for only one year. The students who viewed the program for two years 
scored significantly lower than middle-^income children and poverty chil- 
dren who attended a well organized Head Start kindergarten. 

Sprigle also attempted to obtain evidence on the relationships of 
adults and children on the program to determine the types of interactions 
that occur on the program. Fifty programs were viewed from October, 1971 
to January, 1972. From these programs there were 36 small group activi- 
ties between an adult and a child that were recorded. Of these, 12 were 
randomly selected for further analysis. Adults spoke for 90 percent of 
the time in these groups. Of the conversations, all w^re initiated by: 
adults, 88 percent were controlled by adults, and 12 percent were domi- 
nated by adults. Of the 21 child-initiated comments that involved either 
the use of the pronoun "l,' a personal reference, a spontaneous comment, 
or a "why*' or "how" question, the pronounced tendency of the adult was 
to ignore or interrupt the statement. 

This type of behavior is the antithesis of the suggestions made by 
Meichenbaum and Turk (1972) to improve the learning of disadvantaged 
children. The sharp contrast between this study and the results reported 
by Ball and Bogatz points to the need for further research in this area. 

Attitudes Toward Instructional Television 

Attitudes of students and teachers are generally favorable to the 
uae of instructional television, and become more favorable with increased 
experience. The attitudes of upper education levels are less favorable. 
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In a survey of attitudes of teachers in the Hagerstown (1966) project 
attitudes were decreasingly favorable from primary to intermediate to 
Junior high to senior high school teachers* 

Dubin and Hedley (1969) listed m^^ny studies that reported an in- 
creased favorability toward television after experience with it. They 
also reported that students at the college level preferred small dis- 
cussion classes to television classes and television classes to large 
lecture classes. 

In an interesting study, Carpenter and Grsenhill (1958) compared 
students' stated preference for television with their actual preference 
when given a choice. For business law students, 42 percent claimed a 
preference for televised courses, although 47 percent went to a tele- 
vised course when the choice was available. The difference was even 
more pronounced for political science students. Of these students, 
51 percent stated a preference but 70 percent chose the televised 
course. 

Chu and Schramm (1967) summarized the conditions that affect stu- 
dent and teacher attitudes toward television. 

44. Among the factors that determine teachers' attitudes 
toward instructional television are Ca) how they 
perceive the degree of threat to the classroom; 

(b) how they estimate the likelihood of mechanized 
instruction replacing direct contact with ptudents; 

(c) how they estimate the effectiveness off instruc- 
tional television; (d) the difficulties they see in 
the way of using modern techniques; (e) how conserva- 
tive they are, and whether they trust or distrust 
experimentation. 

45. Among the factors that determine students' attitudes 
toward insljructional television are (a) how much con- 
tact they tJ^hink they will have with a teacher; (b) how 
they compare the relative abilities of the studio and 
classroom teachers; (c) whether they find instructional 
television boring or interesting; (d) the nature of the 
televised programs they have seen; (e) the conditions 
of viewing. 
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students with the programmed books spent only three weeks (an average of 
12 study hours) C9mpared to seven weeks in the lecture. 

Schramm's (1962b) annotated bibliography also included 36 studies 
that compared programmed and conventional instruction. He reported no 
significant differences in 18 studies, 17 differences significantly 
favoring programmed instruction, and only one favoring traditional in- 
struction. 

Silberman (1962) reviewed 15 experiments in programmed instruction 
and found significant differences in nine of the cases for programmed 
instruction and no significant differences in the remaining six cases. 
He also reported a time saving in each of the experiments with the use 
of programmed materials. 



hsrhge (1972) reported the results of 112 'studies of programmed 
instruction that were undertaken between 1960 and 1964. No significant 
differences were reported in 49 percent of the cases, significant differ- 
ences favoring programmed instruction were reported in 40 percent of the 
studies, and the remaining 10 percent of the cases favored traditional 
instruction, 

Zoll (1969) reviewed the use of programmed ins-truction for mathe- 
matics instruction in 35 studies (mostly doctoral dissertations) • Thir- 
teen of the studies compared programmed and traditional instruction, with 
no significant differences in seven of the studies. Of the remaining 
six, three favored programmed instruction and three favored traditional 
instruction- 

Wells (1973) surveyed the use of technology in economics education 
(mostly at the college level). Of the 36 studies included in his survey, 
seven analyzed the use of programmed instruction. Programmed instruction 
provided significantly higher performance in two of the jases, and there' 
were no significant differences in the remaining five studies^ 

Examples of Specific Studies in Programmed Instruction 

Attiyeh and Lumsden (1965) analyzed the performance of students in 
high school economics on a standard economics examination. On the pretest, 
the students ranked in the 62nd percentile of the national norm (students 
without economics). On the posttest (after using programmed materials for 
ten weeks) the students ranked in the 82nd percentile of the national norm 
(students with economics). 



In studies of mathewatlcs for different student ability levels, no 
significant differences were reported by Tanner (1966) for seventh grade 
low achievers, Bobier (1965) ^\,r twelfth grade low achievers, and Meadow- 
craft (1966) for seventh graders at all pbility levels. 

4 

Barcus, Hayjian, and Johnson (196^) used programmed instruction for 
reading and writing Spanish for sixth grade students. When the programmed 
material was introduced after a year of conventional instruction, the 
students in the control group performed significantly better. When the 
programmed material was introduced after one-and~a-half year^ of conven- 
tional instruction, there were no significant differences, indicating 
that the time of introduction might significantly affect performance • 

Reed and Hayman (1962) found no significant d: ierences between 
control and experimental groups in tenth grade English grammar and usage. 
However, when students were subdivided by ability groups it was found that 
high-ability students did significantly better with programmed instruction, 
and low ability students performed significantly better with conventional 
instruction. 



Attitudes and Program Construction 

The surveys and studies analyzed did not contain any information on 
social attitude changes. Attitude data in these studies only measured 
student attitudes toward programmed instruction. Zoll (1969) reported 
that ten of the mathematic studies he surveyed reported favorable atti- 
tudes toward programmed instruction, and in three of the studies ikttercst 
decreased with time spent on t le program. Schramm (1962b) reported that 
students were generally favor xble, although they were more often bored 
with long programs than with short ones and with programs th|it used short 
steps than with programs that increased step size or used longer steps. 

While little information was obtained on the coordination of pio- 
grammed materials with conventional instruction, the value of improving 
the quality of the material is evidenced in two of the studies surveyed 
by Wells (1973). Fels and Starleaf (1963) reported significant differ- 
ences favoring the lecture students in their first experiment but no 
significant differences in the second experiment when the materials were 
revised. Attiyeh, Bach, and Lumsden (1969) conducted on^ '6f the largest 
studies of programmed instruction to date, covering over 4,100 students 
at 48 colleges* Two different programmed books were used, and the stu- 
dents were divided into three groups: programmed book only, conventional 
instruction supplemented by the programmed book, and conventional instruc- 
tion only. Students using one of the programmed books as the only source 
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^5l'< ' n ShwWil and $a9e«;>vath <107O) peJ-formed an oxporiment i^ith colieg^ 




of.lailur©. IJhey eonoltided that tho eaay pi-dgraW prov^lded ;* { 
-,^9/»y.^#iol©«t motlivation tot students with htgli naed iox achievew^rit. - - vlr^^-iilS 

' MfloPheroon (1907) reported that perfcona with hl^h anxiety levels 



€f .,\ required signKlgantly less time to complete the programmed material. 
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it 
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the research on program constrijotlbn is summarised by ischrama <1962|>)4 (^M^ 
The majority o.< these studies were short duration oxperlments with foUege j^ - ' .^ 
• , students. While many the results are interesting, the applicability / 
• *.**f if*^^'^** *<> P'iJB^^V and secondary students might !be iimlted. Som^ v . 

of the studies cjjfced by Schramm i*ill be mentioned ^>&Xon to gl^e an ind^- '-C' f 

cation of typical experimentation, ■ ' , ' 



Si 



Oyd0red^;y^raus Random Sequen ce 

^ . V . 

Levin end Baker (1963) ^tesfed the differences between ordere<;i and. 
scrambled Sequencing of o;ii^- third of the frames In a 180 frame goomotry 
program for second graders. They found no differences in acquli?ltlon or 
retention of knowledge. HoweverV the program was rather short 6nd It is 
reasonably to assume that longer programs would require more order.. 



r 



Size of ^tep f 

_ „ . - ^ . ^ . 

^ 9420 of stepo la measured in three forms J the reciprocal of the num- 
Ibfor of st^ps, thtf amount of material <?ove red in a frame, and the. number 
of errors. , ' 




cant aiffeifenc«i» Detween oveit (trltt«ft>r 6r^«l) ftn4/c0y©»*C^(tb4»Hit)^;r^^!5^'J'^^^^^ 
j^aponding. TKoialgr firi^ McNeil re^rted ^i{6 aighlficftlTt 

and Wiley (106$) reported no ^ighiUmt dJff^renoilli^ >'inth>g«^|>j|f..^^^^^ 
matic^ between the two re«|!on«e modea- .-Ca»pbej'i:(3t,^6i\ r,eporW'n<^-ll'g* C;^^ 
nKicant ditfemcea between overi, <!6v4i^t,\^i(pd're4d*fti t^6iponM$\''"Ai\U<0i^tK^:4ji 




few 



diappee and 

correct response after each error rather m&n jn^tel^ b^infl tdJd the'fC<?p|:??>j^vir>'f^ 
. reot^reapojiae'/ ' 'i': 



Knowledge of Reaulta and Pacing 



1 



Schramm reporwd that the m^ijority of tK^ studies fftvo)r*d Iw&edidtji 
kr^owlodge of i*^suj.ti»« Although individual pacing would appear to bo 
preforavlC'. thoro was no ovldanco in the exp^timonta to support this con 
terttiort* 



" 



'':^:^^^^6ve and. Smith (1081) found no Bi^MUc^tit {Jifferences botween 
groupfl of sixth gMderd (1) who received itnmediate kno^ledgo of reeaUs 
and 'thoso y^ho did not and (2) whp /Worked^ at thoisr own pace and those who 
completed a fixed amount of material each 'weeki 



Confirmation and Prompting 

In tTie confirmation format, the dtudent\ responds when appropriate 
and is then told if the response in correct* \ In' th^ ' prompting; format the 
stimulus and response are pr<^sented simultaneously and the student then 
repeats the response* Most of the stud;Les have shown a auperiority for 
prompting formats* It should be emphasized that the studies where prompt 
ing was successful usually did not deal with concepts or problejn solving* 

* ' i ' ' ' - * 

. Briggs (1961) found prompt ing 'auperlpk* for the learning of map sym-^, 

bbls by high school students* Campbell (lp6l) found no significant 

differences for prompting oi^ indirect cuelhg in a short program on static' 

electricity for Junior high school students* Angell und Lumsdaine, (1961) 

found prompt4.ng to-be adyantage<)us.for high school students in pairing 

English jwords with digits and English arid French words. 



Computer Assisted Instruction » ^ 

Computer assisted instruction is a relatively new and expensive tech 
nology that allows for more individuality in progression toward program 
goals than other technologies* Research into the effectiveness ol.CAl 
is recent and has amply demonstrated Its effectiveness The CAI programs 
for elementary students have usually been drlll-and-practlce mathemfttlds 
or reading programs and have been supplemental to regular Instruction. 
The student receives several sessions per week on a computer terminal* 
(Wellsi Whelchely and Jamison^ to appear^ found a range of 3 to 159 ses-^ 
slpns/ with a mean of 80 sessions I on a yearly basis for students in thai 
s^y») At the college leve},| CAI has been used as a substitute for con* 
ventlonal Instruction and the results have been favorable. 

Jamison, Suppes» and Wells (to appear) have provided an extensive 
analysis of CAl experiments at the elementary and college level « and the 
discussions on the effectiveness of CAI in this section closely follows 
their discussion. The discussion of the effectiveness of CAI for cognl«* 
tlve outputs will be followed ^by an analysis of noncognitlve effects of 
CAI presented by Hess and Tenezakls (1970) and Smith and Hess (1972). 




to the leotur« oUsf m college Oerwftn< CAI atudeots were 
reading and writing ability. No signifitattt differenci^i^ 
in Uftteninfif or (Speaking «bUltled* 



suppes and Mornlngstar {im) reported on the u$e Of CAI aa ft w^y 
placement for the normal Qlassroom honrfl of'aa introductory college"^*' ^/ V^' .•'4k; 
Buaalan coXiree. Five hours of leoturee were leplaced «ith five CAI hourr: 
each week, The dropout rat^ for the CAl ?eotton nj^s less than half the 
dropout. rate of the regular 8eotlon> In addition, the CAI student? ^^,\.'-<^\)ryt 
formed better on the final oxamina'jion. ' ^iv?-;] 



Three studies demonstrated the reduction in time that occurs for 
<jAI usage. Axeen (1967) used the Plato syatem for teaching library use 
and found no significant differences in test scores, but found that CAI 
students took less timo. ' * - 



Bitzer and Boudreaux used tho Plato syst'em.for ,a nursing course 
and found that the average student using CAI completed the eiatSJr|a.ls iP ; 
80 h<5u»'« compared with 84 leoture hour^. ■ '■'-''■y s'^'^f^' '^^ '/'PlM^ 

Homeyer (1670) used" CAl >f or computer pj«graiBtoiog. Atth4u|;^VhV,|$ufi!^^^^ 
no significant differences m ^^^aiftlnatlons or grades tot p^ograils »?l|<ie^^^^^^^^ 
by the students, he did find a significant t^tte savings, CA; |tuaant|^<J?^y§}^^^^^ 
used an average of 13,76 hours compared with 24 hour,s for the . leotvj|re.^i,' '^tj-^ll 

. ' ^ ?t -."Ay 
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Eleitentary Level CAI ".'^"iA 

Vinsonhaler and Baas (1972) recently aurve^ed ten studies in CAI 
effectiveness. These ten studies included 30 separate experiments and 
involved over 10,000 students. Vinsonhaler and pass concluded that there 
was strong evidence that CAI was effective where effectiveness was mea- 
sured by standardized test scores. '-'^ 
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Suppes and Morningstar (1969) reported the results of the evaluation 
of a drill-and-practice program in mafthematics, which was used at our 
sch-^ols in California and 12 schools in Mississippi, CAT programs were 
used for all grade levels- To evaluate the effectiveness of the programs, 
they administered the Stanford Achievement Test (SAT) using different 
forms for the p^^^^test and posttest examinations. 

The four California schools were matched in two pairs according to 
school district, and in each case one school used CAi and the other did 
not. For schools A (experimental) and B (control) there was a signifi- 
cant advantage for CAI students in grade 3 but a significant disadvantage 
in grades 4 and 5 (there were no significant differences in grade 6) - 
For schools C (experimental) and D (control) CAI students were favored in 
grades 4 and 6 with no differences in the grade 5. At the end of the 
school year, investigators learned that the teachers ^nd administra- 

tors at school B had added 25 minutes per day to mathematics instruction 
fo the 4th and 5th grades. This increase in instruction caused the ap- 
parent disadvantage for CAI and demonstrated that a.i increased effort 
along other dimensions could be as effective as CAI in supplemental 
instruct ir^. 

The 12 Mississippi sch^uts were divided into eight schools with CAI 
and non-CAI students, three schools with C/ ! students only, and one school 
with non-CAI students only. The CAI studrnts performed significantly 
better for all grades (1-6), and in most cases gained one-half grade or 
more above the gain of non-CAI students. 

In a further study Suppes and ^lorningstsir (1972) analyzed the per- 
formance of students according to subtests of the SAT* The subtests were: 
computation (grades 1-6), concepts (grades 2-6), and applications (grades 
4-6). Mean gain scores were compared for students in seven California 
schools and for two groups of students: mixed classes (CAI and non-CAI 
students in the same class) *5nd separa tfi d - c 1 a . s s «s (CAI and non-CAI stu- 
dents in different classes). Of the y^O test comparisons, CAI students 
outperformed non-CAI students in 29 /cases. The difference was signifi- 
cant in only 10 cases listed below:! 

Mixed classes 

Computation: grades 3, 4, and 5 
Concept : grade 3 
Applications: grades 4 and 5 

Separated classes _ 

Computation: grades 2, 3, and 5 
Applications: grade 6 
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Non-CAI students had significantly higher scores in grade 4 in the sepa- 
rated classes for the concepts aud applications subtests. 

Weiner (1969) evaluated the use of CAI for mathematics in New York 
City schools and used the Metropolitan Achievement Tests for measurement 
of CAI effectiveness » In grades 3, 4, and 5 the CAI students scored 
significantly higher gains, even though they had significantly lower pre- 
test scores. In grade 2 the pretest score was higher (insignificantly) 
for the non-CAI students and higher (significantly) for the CAI students. 
In grade 6 the gains were insignificantly higher for CAI students. 

Atkinson (1968) reported on an experiment in CAI for reading. Stu- 
dents in the experimental group received CAI for remedial reading, while 
students in the control group received CAI for remedial mathematics. The 
experimental and control groups had similar characteristics and were all 
in the 1st grade. Scores were significantly higher for the experimental 
group on the Hartley Reading Test and all subtests of the California 
Achievement Test, with the exception of the comprehension test. The com- 
puter system used in this experiment was an expensive one; each student 
station had not only a cathode- ray tube and a keyboard terminal, but also 
an audio and visual display unit and a light pen for the cathode-ray 
tube. 

Wells, Whelchel, and Jamison (to appear) evaluated the effectiveness 
of a mathematics program ip CAI for grade 5 and 6 in California schools. 
The students were stratified by grade and sex for the statistical analysis* 
Although the non-CAI students had higher scores on the pretest of the 
California Test of Basic Skills, the CAI students had significantly higher 
gains in three out of four cases. Interestingly enough CAI students in 
two of the groups also scored signif ic^antly higher on reading tests. The 
result for the reading test should eliminate any concern with decreasing 
performance in other subject areas when CAI is introduced fo:r supple- 
mentary work in one subject area. A regression analysis was also used to 
determine the amount of the effect and to control for variations in indi- 
vidual abilities and teacher characteristics. For 5th grade boys, an 
additional session of CAI resulted in an increase of 0.004 grade equiva- 
lents on the test. This result seems numerically small, but if linearity 
was maintained for 100 sessions of CAI the gain would be 0.4 grade equiva- 
lents. 

Noncognitive Effects of CAI 

Two of the studies reported below analyzed the effects of CAI on the 
attitudes of students? toward themselves, and the third study .attempted to 
measure the use of the computer as a socializing agent. 



A-28 





. . rai^tios, and social relations* -.Tho sample usdd for , 



"0-1) of 169 students. with CAI and 161 wlthov^t in ^r^^es ^, 
f ' general result observed was nb' significant dlffe'ertc^ 




it 

|.f.' ^ t)lllty of u^ing the computor, fte a 

' ^ ue^^for math^maUos In^tructloft ol 7th 
CAl for reitt^^Ul W6rkt 

'%K > The effectiveneed of a commyntcator yaa measured 



Experti&e-'-Amouht of Information i validity 
ability 
mistakes 




Tryatworthiness— -Inferred from items dealing with motivating '%^V } ? 



power of computer • 



• C}^ari&ma-*-InfalIibility» limitless endurance, unpredicta- 
bility! and unresponsiveness* 

The majority of the students felt that the computer gave the right 
an((werS| had ^large^ amounts of informationi pould answer all que^tion^i 
- would make few mlstake9> atd was* smarter than textbooks* The students 
r were divided on the, relative intelligence of computers^nd people. In 
terms of expertise, the computer was also rated higher tnan the teacher 
: on' all items* / . / w ^ .^^^ ■ ■ ,. 

> I * - JO 

\ In terms of trustworthiness students were generally satisfied with 

. thd computer for use in' math and were satisfied with the problems chosen 
by the coraputer and the. scores Jhey received from the computer. The ^ ^ 
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;th^ student aWUtiod 
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the exteiit thaV paople rely on 
the computer may 'have magnified J^lf^pta^ 



Other advantages of a computer io^t^^^ atudanta 4a Ha neut^a^ 



pared to a teaohexi f^nd tfiV J^n<>^4M^ tgeyH^lc th^f r f r<?ft; tt\e ?|f|j*||^i 

puter* The major disadvantage ^0et^|;^ 'c(^ntr<ii . tl^^^^^^^^ 

has oyei;^ the direction of a cpmputej^ i 
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from commercial concerns to uniyersitsios^and fouh^ to various 

branches of <:overnment. The res^isirch /evaluates the effectiveness of film 
in meeting many diverse educational objeQilvee, each as; 

t Motivating the student tp learn* * ^ 

• Imf^arting factual kiv>v;iedge» ' 
- • Teaching perceptual motoV skills* 

• Stimulating student participation, in the learning process* 

• Changing student attitudes, opinions, and behavior. 

> Reinforcing (or revparding) the student *e acquisition and 

use of knowledge. . : ^ 

This review of the off diet* venesa of instructional films relies almost 
exclusively on three ot her - reviews of the lit^raturer Hdban an* v^in Ormer 
(1960),+ Llonberger (I960), and Saettle^ (1968) / All of the sj^cific , 
studies to be cited here are also cited in those sources/ • 

\\ ■ ■. . . .. .,.*.-. /..:'■■..%,„•-,> . . V:.-/j^.v.'^ ' • ■ s .--^ . 

■ ■. ■ . ' . . ■ ■.,,.•■.•.,.„,.■ , : < \ -y ■ M • ■ • 

tn thic review we are primarily interested in the effectiveness pft 
instructional Jllm along cognitive ^.dlm^nsionife^f For thi? redfion, we will M Vif 

fii'st discuss the effectiveness of film^in^teachlng faotai . concepts, 6nd ' 
skills. We will then briefly examine |he evidence on noncognltjye goalfli - 
such as motivation and attitude; Olxdng^/ Indtructlorial^^ goes 
beyond the model for most Research on the effectiveness of educational . v 
technology, since the mod^l is only the comjterl son Of _ipne medium (further -.^'^^ 



^This analysis of film research was prepared by 8ft I to augment the analy- 
sis by Wells in Part 1 Of this Appeidix* - 

t ' 

Relerences are listed at the end oi^ this Appendix. 
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unspecified) to. ^conventional instructioix (iurthei^ unepeoified)* However, 
instructional film ^research is^atlU not very sophisticated • Fot^ instanc^j 'J^; 
in looking at film effectiveness in conveying fa'otUa 1: knowledge, lit t^^^A^^^^^^^ 
dlstlttctiofi' is made betwee?h ^c<fUiring facts and accepting 'thern^ or ^cciixi^k^^m 
ing tactsland using them. The lack- of such dlstftiLCtlon "may account for , \^ 
the variation in results of different studies. ^ ^ , 



Sturfjes of Cognitive Effectiveness 



One of the best*'known sti^dles dealing" with the teaching of facts ^ItH ;( 
filiii was ilone by Holaday and Stod4©t*d (1033)» They concluded that the 
general Information of both children and adults id increased by infonnation 
shown irt motion pictures^ and that retention of specific incidents is high* 
They a Iso concluded that incorrect information presehted jln f i Ims is usu- 
ally accepted as valid unless the errors contained are glaring* 



three Studies of the Army orientation films Why We Fight Bone by 
Hovlanrt# .torosdaine^ and.Sheffield (1949) showed that these films had fi 
slzeablOf effect on increasing the fa^jtual knowlejjge of trainees on the 
subjects covered* The group of trainees shown th^ film learned from 14 t^^i^- 
22 perclrtt more than the control group, on t;he average • When ^the r^^ults^^^^^p^ 
were cCmpared on the bisis of the years o;E education of the traltiees, the 
studies concluded that trainees with moj^ education learned significantly 
V ihore from the f ikas* ' 



/ Two sttidles of the Yale Chronicles of American Ptiotpplays, Wls^ 
(^39) and Know Ito and Ti Iton ( 1629) ;^ showed that film plus convent lohal 
Instruction is more effective In teaching historical facts than conven- ^ 
tional lnstructiion alone* Knowlton and Tlltorf foundi I\owevor; that the^ 
Photoplays interfered with, or at least did not faqlfitate the teaching^ 
of time relationships. 



Two repcrts on the Nebraska study of the enrichment effects of motlo^ 
picture^, Wise (1949) and Scott (1949) , suggest that fiim's are very spe-- 
clf Ic in their effects. The superiority of fllm-suppiertented it^st 
in the specific areas covered by the films was reliable and appreciable. 
On the other hand/ on standardized tests administered before and after the 
semester^ no such uniform reliable effect was fotmd. ^ 

The conclusions reached by H'obah and van Ormer (1950) on the eff^c- 
ti\reness of films in Imparting coghitlve knowledge Werej 

• Films can be good communicators of Information that cai^ be ■ 

presented visually, but film presentation may sometimes i 
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tent is touted to th« instruotional'^pbjeptlve. Th^'e ie ^ 
. ; . . nothing in the motion picture pVeientdtioh, per ^eV that ^ .; :V ;;^f^ 



. .. guarantees better learning.* ;, " . . ..<r^?«-;fp 

«r Research does not bear* out the notion tn»t filft learning , ''' '^^VJ: 
IS passive. Some studies show that the contribution of v^.; 
, good instructional films to the comprehension of under- 
* ' • • standing- of facts fs gmter thian their con'trifeution to 
the rote memory of details presented in the films. 

• .The toTC0 ot mo<iApn pictures in eonununi^atidn $eemQ to be 
0* $ucti a riature that the influence of certain tUtis on 
factual knowledge may peralst over a long period of time* 

Cottparl son. Between Films and Other Media /and Methods of Instruction 

Although the teeiilt of 611 the research is not consistent, most ^ 
, studies suggest that the adfdltion of films to conventional .instruction 
\. increases the amount learned, this effect seems consistent- when the ; 
fiAi and the other instruction are designed to reinforce each other,. ^ 
Studies ihat compare the use of film alone to convegitipnai' in8tr^otlon 
suggest that for certain topics and for limited iobjeotives: in teaching ' t 

■ Information and concepts, suitable instructional films inay be mbre effec- 
r. tlve in the instructional process'than poor instructors, and at least as 
effective as average Instructors. In many studies comparing film presen- 
tation with lecture or demonstration, the films reduced the ^fnstruOtlohal 
time required\ (sometimes as much as one-half to two-thirds) with |lttlo ; 
M^r no Saorifl-ce of instructional results. ' ; 

• ^ . • *■ 

Noncognitive Effects of Films . , 

The motivational effectiveness of films has not boen Well researched. 
! Research presents no evidence that laotioh pictures reduce academic moti- 
vation'; that is, that they result, in less voluiitary reading less- voluntary 
participation in classroom recitation, or greater avoidance a specific 
' course of study* The scanty experimental results do" sugge^st that audlo- 
visual demonstrations in general may have som^ faltly longMaeVhg motlva^ 
" tlonal effects, but we know too little about motivation in thisUrea to :^ 
i|se it with consistent effectiveness. \ .\ 

'■ ■■. . . ■ ■ . • : , •. - • ■ ■ , ■ -.v. : • 
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l''\u-"k^ /PM^ c6TVf»M%i6n botw©0n h6w ftuch students liked a lUm and;;h<>f »^h.X^ ^ 

/ ^C^" V fl^^Wnce$ or persffoctiv^s are not successful; stu(ii0? fy filck, Vai> Jloi*n, 

I ^iri^ Qerbri^f (1064) and by P^tex^nj^rt and Bouscarfen (10S4) bd^jr tMijpi(p^t< ' 




tog^^ther '^asi. a much faster ^ay of .relieving the anxiety ihai^ taking , . ! 
better Oare of their teethe ' ^ ' :^^.';^i^4f^ 



The evidence^ on the effects of films 
Hoban and van Ormer (1950): ^ 



s on attitudes U suiwna-riaed 'fcy,/V";V/^*^?^s 



Specific attitude changes, can result from certain motion \' \''Sy<'!'^M 



atea::-io'^:tH0t^Wii?*I^^^^ 



pictures whose content is closely related 
the s^eolfio attitude* 

The effect of fllms^^on specific attitudes can be^cunial&tiV^ 
for two or wore pictures on the saiije ^ooia>l theme # Th0 1,^^'*^^ '^i\fl^^j^01 
cumulative effect may result oven though sopi^ films in ^'h^ / J^^^^^^^^ 
Sequence may be in^i^idui^lly ineffective in t^liably inf 5^,?^^ 
encing a 'specific attitude* . '^'^ ^ 

VHien the initial influence of on$ of more films on a spe-** ' .:y,:^ 
clfic attitude is large > it may persist for ^eekd or months, , V. 



generally vith sorue diminution* ^ ' J ^ 



Few, if any^ specific attitude changes will result when th6 ^ i ''Ff ^ 
film bias is strongly Contradictory to the social norms. In 

the case of contradictory influencesi film bias may, actually V n^^^!j^ 

reinforce the existing attitudCi rather than modify it. 'fY 

Films may not exert the same attitudinal influence within 

a nonuniform population^ such as one in which different " Xj 

occupational! social, or educational backgrounds are -.^ "T 
represented. 
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Appepdlx B, 
BWWETARY OJST ESTIMATigS FOR FIVE 



Intensiveness and /ExtensiVenesfl - ■, * . 

' . Details, of the cost ostlmates suiranartzed in Seption ll-J bl the »aii» . 
body of th^ text of thU repoSjt are presented horein. The ©stimate^ ateSrv'-?^^^ 
for f^ve instruotipnal technologlia*/ or jjedia.' (1) broadcast, caW^, and^/lvf^ilv 
video cassette Inst^uctioAaX television; (?) XOni^ fU«r (3^ pjro^ramhied'^^, 
text J ^.(4) Computer based intst^juotions 6nd ,(6) audio cassette ^^O^ndr ^ . .'k^^^^^ 
flllnstrip. The approach here 'id .to deflno two vajjiables and to coffJ^Wi/vJr^;'^^^^^ 

,v,the co^ts;;p.f ; using ■■feaciivo^ir th6^:aix> 

; those, variablee,^:^:. -bi^^ya^^ 
lates. to; th© ' n^mb^r' of :i^ni»tes:^;i^||4t<^^^ 
,isglvenr-t$© ^cither 
: to- the numbei-:, of :>tud^^^^^^^ 

in^- e^ch ■variable ^ "^omi-tmiM^^ :iti^Viii-:#id^i^^^ 
oircuttstano©s, while m^itttaihinfi: co«|5aydl)iilty' <>t the ©Vtiiftat©^ Hi»WMd>y%'f;^|| 
the reader should be aware that ^he noraal uses of a iiiven vrtldliio wisKt ' isV^^t: 
not be compatible over the entire range fts:«i^ned (e,g,/ aound*fii|»^trip»;. -1^^/ 

.Ufii^d -'iine. hpuy/day^ b^^^^ 

-too large or too sjnall for the 'So$t-e£f active operation of the mediuiV "^^^^^-^^^^^^^^ 

Since infonnatlon onnhe ef £ectlvene$s o£^ different systeW in ^elt^ 
Instructional or organUaticfnal tema watf' not included Ih the cost stady^/ 
the ^offectj-veness diaienslons of different system scales will not bp • . 
'evicfent in the cost figures ohtalnei here; What \vlll b^ 
the; extend o^f cost advantages or disadvantages at different levels of ; 
useV both in the amount. of time each student uses the media system per 
week and the niunber of student, users • 

In addition, the lack of empirically leased evaluation standards for 
learning t^aterlals means that the costs of such, materials for' each eyBtptA 
cannot be developed in reference to iiteclse sp^olfloations of cbmparable 
learning tasks across the me^la. In some ways this ^make$ a (2o6t;$t^Uj4y o 
easler/^ In that instructional "Hwks'r will haye^ to be neu with respect 
to subject material; the *'tasks" will relate^ only to one common dlmenMon^ 
Intensiveness. In this study the single "task*' dlroenslorf used is simply 
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the amount of time per week^ on the average, that a student would receive 
instruction from the media system. This means that the real differences 
among the media and their relative appropriateness for different tasks 
and the different instructional results obtained will be masked in the 
cost figures* 

Instructional Tasks and Environments 

General expressions for three instructional tasks v/ere chosen that 
would provide to each student, on the average, sufficient material to 
occupy different amounts of his total instructional time, as shown below: 

Task Intensiveness 



I 20 min/week/pupil 

II 20 min/day/pupil 

III 60 min/day/pupil 

If the total instructional time (excluding lunch periods, recess or ex- 
ercise periods^ and study halls) of each student is five hours per day. 
Tasks I, II, and III correspond to 1.3, 6.7, and 20 percent of the 
student's total instructional time, respectively. In reality, som^, 
students will use only a few of the media and not others; some will use 
no media; still others may use a given medium more than these percentages 
of instructional time. The instructional task is general in nature so 
that it may be applied to any media system* Twenty-minute segments were 
ch6sen because this corresponds^to (1) the average length of films, 
sound-f iimstrips, c.ad instructional television programs and (2) two 
10-minute or one 20-niinute lesson on a computer based system. The range 
of times chosen is sufficient to cover the spectrum from typical present 
uses of film to extremely intense uses of each medium. The reader 
familiar with the General Learning Corporation study^i* from which the 
basic approach described here is derived, will note that it used only one 



* 

References are listed at the end of this Appendix. 
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instructional task^ 'A/hich corresponds roughly to Task H above. Variations 
in cost with extensiveness and intens iveness of use will yield a measure 
of the economies of scale of each of *-he ^.^edia examined.* 

four environmenLs were chosen to represent a variety of geographical 
areas and population densities actually found in urbanized parts of the 
United States. State and regional areas w^re omitted from the calculations 
to make the task more manageable; interested readers can find a discussion^ 
of the costs of instructional television systems at the state and regional 
level in Linvill et al.^ The characteristics of the four environments 
are summarized in Table B-1. 

Local District I represents an exurban area having an enrollment 
slightly under the 1971 national median. IL.e district has an irregular 
shape^ but all schools lie within a circle whose radius is five miles. 
In Table B-l, this is called the radius of the smallest encompassing 
circle. The area and population may actually be made up of two or more 
smaller administrative units joined in a cooperative effort to share the 
costc of some of the more elaoorate media systems (e»g»^ television). 
Local District II represents a joint undertaking by two adjacent^ developed 
suburban school districts, each approximately the size of the Palo Alto 
Jnified School District in California • The City and Metropolitan models 
are modified to fit a K-8/9-12 configuration from the General Learning 
Corporation's 1968 study (Ref. 1^ pp. 5-7, summarized in Ref, 4, pp. 3-4). 
In the Metrot model it is assumed that sschool districts in the area would 
cooperate on large media projects where economies of scale of operation 
could be achieved. 

The elementary schools in each configuration are intended to repre 
sent a K-8 configuration, and the secondary schools include senior and 
vocational high schools. Throughout the modeling process, an elementary 
school will have between 500 and 700 students (with a mean of 600) and 
20 or more classrooms* The secondary schools will have between 1,000 
and 1,500 students and 50 or more classrooms. The totals for each con- 
figuration are rounded to form convenient numbers. 



Schramm (Ref. 2^ p. 79) has termed media use of the order of Task II 
'^a very heavy use of instructional media, not [the use of] a few 

films in a course or presenting supplementary materials by filmstrip 
or tape.'* Task ill, three times this level, was included to represent 
the upper boundary on media use with present knowledge, 

^In this report, the words "metro" and "metropolitan" are synonymous. 



Table B-1 



ENVIRONMENTS, OR EXTEi;SIVEN£SS OF MEDIA USE 



Local District I model parameters 
Student population (K-I2)* 
Total population (approxim^^ite) 
Area 

Population density (average) 
Approximate shape 

Radius of smallest encompassing circle 
Number of elementary schools 
Number of secondary schools 

Local District II model parameter i 
Student population (K-12) 
Total population (approximate) 
Area 

Population density (average) 
Approximate shape 

Radius of smallest encompassing circle 
Number of elementary schools 
Number of secondary schools 

City model parameters 

Student population (K-12) 
Total population (approximate) 
Area 

Population density (average) 
Approximate shape 

Radius of smallest encompassing circle 
Number of elementary schools 
Number of secondary schools 

Metropolitan Area model parameters 
Student population (K-12) 
Total population (approximate) 
Area 

Population density (average) 
Approximate shape 

Radius of smallest encompassing circle 
Number of elementary schools 
Niimber of secondajry schools 



10, 000 
40^ 000 

53 square miles 

750/.square mile 

iri'egular 

5 miles 

10 

3 



30, 000 
110, 000 

50 square miles 

2, 200/square mile 

rectangular 

5 miles 

34 

7 



150, 000 
800, 000 

70 square miles 

11, 500/square mil€ 

rectangular 

6 miles 

169 

35 



600, 000 
2, 100, 000 

1, 500 square miles 

1, 400/square mile 

irregular 

30 miles 

677 

139 
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Coursejvare Time Requirements 



The three tasks must be treated further in order to determine the 
number of hours of unique programming required of the instructional 
courseware • The most critical factor affecting the amount of unique 
programming required is the number of students v;ho use (or in eract with) 
a specific instructional sequence in any given year. A convenient de- 
scriptor of such patterns of use is in t.arms of joint use among grade 
levels in an elementary setting or among different courses in a grade 
level in a secondary school setting. Since the trend in education is 
strongly away from such rigid organization^ this description is somewhat 
archaic. For the purposes of this cost study, on the other hand^ what 
mattertj is the requirement for courseware and the scheduling of course- 
ware distribution, rather than the particular mode of use in the learning 
setting. Thus if the term "grade level" is used^ it can equally well be 
interpreted as the equivalent number of students at the equivalent learning 
lovely while allowing flexibility in the organization of learning at each 
specific site. 

With this understanding, the nuifUber of hours of unique programming 
required for the two local district environments can be selected. Guidance 
in these decisions was obtained from the 1972-73 instructional television 
schedules xor schools in (1) the Anaheim City Elementary District, ^ (2) 
the Santa Ana Unified School District^ (both in California) and (3) 
Washington County (Hagerstown, Maryland).*'' The final form of the pro- 
gramming types at the secondary level was developed from Ar;;>endix C of 
Ref . 3, with a substantial reduction in the number of vocational education 
options offered. The resulting programming requirements are shown in 
Table B-2 for an intensiveness of 20 min/day £or each pupil. 

If one proceeds sequentially through the various grade levels in 
Table B-2, it will be evident that this configuration implies a signifi- 
cant use of media techniques in delivering core instr4i(C^oiv to each 
student. More importantly, the intensiveness of use is designed to be 
the sajne for each student over all twelve grade levels- An increasing 
number "of options is available in the higher grades to satisfy the 
student *s more heterogeneous subject and treatment requirements, especially 
as between academic and vocational preparation- ^ 

Generally speaking, programming is represented as common to all 
students in each of the first six grades, with options available at the 
seventh and eighth grades for one-third (20 hours) of total programming 
received by each student. In grades 9-12, programming is divided for 
each student into three equal portions. One-third is common to all 
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students, a second third is specialized as to r.cadeinic or vocational 
preparation but is taken by all students in each specialization, while 
the last third consists agaisn of options available within each special- 
ization, j 

There i3 nothing sacred about the structure of these programming 
requirements. What is important, particularly for the costs of television 
systems, is the uniformity of coverage of grade levels and the fitting 
of the medium to the program of the secondary schodls, rather than trying 
to fit the schools to the medium. 



Programming Requirement for 20 Min/Day /Pupil 
in Local Districts 

The total unique programming requirement at 20 min/day/pupil is the 
sum of the elementary and secondary figures . As shown in Table B-2, this 
is 1, 200 hours. , ^ 

Programming Requirements for 20 Min/Wk/Pupil and 
60 Min/Day /Pupil in Local Districts 

Programming requirements for 20 min/wk and 60 min/day average in- 
tensities are respeptively one-fifth* and three times the 20 min/day 
intensivenesa. Dealing with the totals only (the reader can readily 
compute the corresponding elementary and secondary requirementr ) we have: 

Requirements for 20 min/wk = 1/5 x 1, 200 

= 240 hours/year 

Requirements for 60 min/day = 3x1, 200 



= 3,600 hours/year. 



Assuming a five-day week. 



; .V' ^^'^ *^ ouri:»lculum dl<f0ronco$ ao;ros$ schools; in ^th^^jS Urger/ ; ^\^^':^ 

"nV/ a^pl&^col^t lncreft$o In unl^iue pi*ogramming requiremonts wlU be taken " ^^['^l^lX/f 
llv- -^^r to i;©pfosent this tot tho otty, and h id r>^rc0rit increaso for the * ^ ' 



Tnetis:)politan area. The summary figures are given In Tabl& ^ ... .^^^^ 



Table B*3 



!>• ' REQUIREMENTS FOR COURSEWARE UNIQUE PROGRAMMIW 

(Hours per Year) . 



In ^ ens iven.es 8 • v^* 

• Twentj/ Twenty Sixty ■ vi'^-ij 
jV".'^ ^ Extenslyeness Mlnutes/WeeK MlnUtes/Pay ' Minutes/jPay , 

^iv'':-- ■ ■ ■ v'':--' ^ ■ V".-^- ' . ' iillili^ft 

• 240 . 1, 200 3, 600 . ifiSfe 
^ ^^! City -300 ' 1^ 55o 4,500 ' ^i-V-'-u^ 



Metro ' 360 1.800 5,400 ^^^^r^^•^ 



.'^^^ impacts ol increased courseware requirements at the city aft^ metro 
10, levels are felt principally for i|iedla having centraii?:ed prpduction or 

jf/; broadcasl^^di&tribution systems^ sucl^. as instructional television*,/ Ijf ; 

tional film libraries In large cities)^ requirements for an increased 
f> \ range of courseware can be met by varying the that is purchased rather 
\ than increasing .'the . total number • • . ' v 

^fm^'A-W^V-^'^'^^y}.--., . '. • ■ * . : # .» ^ - - -- -l - - ; ^ : r T-'-^-iiive 




Bllliitt Coats Examined* ' ; ^ ^^r" ^'^--^^^^^^^^^ 

Costs can be categorized along two dimensigns^ function and tis^* . : / >'-fJ 

Adapted from ftef* 4, pp. 7-10. ^ . • 1 
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Function 



Costs can be classified in terms of production (of the instructional 
content, or courseware, from which the student will eventually learn)^ 
distribution (of the instructional content by mechanical or electrical 
means to the leaniing site, and the return of learner feedback), and 
presentation (of the instructional content to the student in a form 
suitable for learning), 

Production 

Produc::ion costs encompass all expenditures incurred to design 
the media curriculum and to obtain, evaluate, and update the courseware 
used in the media system. This includes costs of selecting and ^c uiring 
courseware from external sources as well as costs of local courseware 
creation. Specific examples include planning^ writing scripts, and re- 
cording programs for television based systems, and writing, debugging,^ 
and pretesting programs for computer based systems. 

Distribution 

Distribution costs are those incurred in converting the instruc- 
tional content to a transmit table or transportable form, sending it to 
the learAin^ sites, receiving it there^ and returning any learner responses 
and records required for the media system to operate. These include 
duplication (if required) and transportation costs of copies of an in- 
structional program and the communications costs of electronic systems. 
Television transmitters and receiving antennas and computer two-way data 
communication links between learning sites and central facilities are 
specific examples. 

Presentation 

Presentation costs are those incurred in changing the form of 
the received material to a form useful for learning by the student. For 
computer based approaches, this includes the cost of processing the in- 
structional program and student responses so as to obtain a sequence of 
interactive experiences adapted to student needs. Specific examples 
include costs of computation and memory^ student terminals, TV receivers, 
film projectors, screens, and all communications wiring within the learning 
site (schools). In-schooi instructional personnel costs depend on the 



B-11 



deployment of staff; which can vary radically within and among districts 
having otherwise the same media system. For example^ Anaheim employs 
television in a team teaching context, ^ while Santa Ana employs it in 
self-contained classrooms. ^ Consequently, personnel costs are considered 
separate from the presentation category in the analysis. 

Time 

Production, distribution, and presentation costs can be further 
classified as either capital or recurrent costs. Capital costs are costs 
incurred to purchase goods and services that have a useful value of 
greater than one year (the usual accounting period of school systems) 
or that need not be purchased every year. Recurrent costs are the operating 
costs of a system^ the costs incurred to purchase goods and services that 
are used up within a year or are purchased every year. The following 
lists encompass all the cost elements explicitly included in the modeling 
exercise. 



Capital Costs 

The activities and facilities listed below come under the 
heading of capital costs: 

• Initial planning* — Planning extends from survey of 
needs to evaluation of alternative proposals. 

• Initial training — Production staff and operations and 
fl*ain4>«naacfiL_p£rsoiinel may need trc ining and, especially 

important, classroom teachers may need training to 
effectively utilize the media system. This training 
depends on system size and complexity, familiarity, 
intensiveness of use^ and desired quality of per- 
formance. This item is too frequently oniitted in both 
system adoption and cost estimation. 

• Facilities — Where space at least the size of an entire 
room; is required to perform a media function, this 
spac^ is costed as new construction an a consistent 
per square foot basis in lieu of a more precise 
estimate on available space. 
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• Initial equipment and courseware—The courseware re- 
quired to implement the syst^, including test equip- 
ment and an initial inventory of spare parts, is 
included in this item. In practice most courseware 
(except live television programming) has a useful 
life of more than one year and wi^l be treated as 

a capital cost. 

Recurrent Costs 

The following activities are considered to be recurrent costs 

• Operation of equipment — Operation includes the salaries 
of system operating personnel, and the cost of utilities 
and recurrent .supplies. This cost will vary with the 
medium and the system design. 

• Maintenance of equipment and facilities— Maintenance 
is typically ten percent of the initial purchase price 
per year, or about one percent per month of operation. 
It includes replenishment of spare parts and stocks, 
replacement of test and repair equipment, and prorated 
building maintenance costs* 

• Con '^inuing teacher planning and training — Updating of 
the media system requires additional training, as does 
courseware and per sonnel^ tur no ver . This activity is 
subject to wide varisftion in practice, and is very 
frequently not undertaken, to the detriment of the 
system's performance J It is co'sted as the sum of a 
courseware preVievj^ cost varying linearly with 
intensiveness and a fixed percentage of the initial 
training cost. 

• Administration — Administration varies with size, 
character, and use of the -media system. Salary costs 
increase at a diminishing rate as the system size 
{as well as its extensivenessi increases. For non- 
electronic systems (audiovisual media), communication 
costs such as travel, telephone charges, and mail tend 
to increase rapidly with system size and complexity. 
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The electronic systems^ on the other htind, have the 
potential to carry a large part of this burden 
themselves during nonteaching hours.* 

• Related materials — Printed material providing 
directions^ schedules^ guidelines^ lesson plans, 
and so forth is required. Sovereign, the economic 
consultant on the GLC study/ notes that the cost of 
this material is closely related to the number of 
hours of unique progranmiing and to the total number 
of users of the system (teachers and students). A 
cost for each hour of unique programming can be 
assigned and then extrapolated over the number of 
user-hours as the extensivoness and intensiveness 
of the media system increases (Ref. 4^ p* 9). 

• Research, testing, and evaluation for system 
updating — Evaluative feedback is essential to ensure 
proper operation and to guide improvements of the 
system, including the courseware. For each media 
system this cost increases with student user popu- 
lation, number of subject offerings, and intensiveness 
of media use. Costs are assigned to this function 
only for the two higS^ intensiveness tasks (20 and 60 



min/day/pupil) inasmuch as few systems would engage 
in more than administrative feedback at an intensive- 
ness of only 20 min/week per pupil. Unfortunately, 
none of the three district ITV systems that we 
contacted — Anaheim, Santa Ana, and Washington County — 
carry out such an evaluation on a regular basis, even 
though their programming is on the order of Task II 
or greater. Only computer based instructional systems, 
for which feedback and record keeping is integral to ^ 
the procedure, and for which much lower separate costs 
need be assigned, appear to perform this function on 
a regular basis in ongoing systems. 



This possibility is in evidence in the Santa Ana system, ^ where a sta 
development informational program is broadcast once a week. 




* 
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Support Costs and Direct Costs 



The various cost elemi nts outlined above can also be classified as 
either "support costs'' or ' direct costs." Three of those el^ents Will 
be designated as support costs; they are: 

• Initial pl^rinang 

• Administratioi\ 

• Research, testii^, and evaluation. 

Support costs are incurred to initiate, sustain^ and guide improvements 
in a media system 4s a whole, rather than for air one function in par- 
ticular. The rems^ining costs will be termed direct costs. 

I. ' •■ 

Amortization and Equivalent Annual Costs 

To compare systems having a different proportion of capital to re- 
current costs, it is necessary to convert one of these to the form of 
the other and thei) to sum them* "Capitalizing" the operating cost on 
the basis of some social rate of discount and then adding the initial 
investment is C£ lied the "present value method" and is the approach 
typically used fv->r single investment projects, such as water resource 
development. On the other hand, for an ongoing activity such as education, 
the natural and preferred approach, and the one used in this study, is 
to convert each capital cost to an equivalent annual cost on the basis 
of its lifetime and the discount rate. (ten percent was used in this 
study), and then to add these "annualized" costs to the recurrent costs 
to obtain the equivalent annual cost. 

The standard formula by which to convert an initial capital cost 
to an equivalent annual cost is the following: 



n 

r(l + r) 

annualized cost = r x initial capital cost 

n— 1 

(1 + r) 



* 

See Ref. 10, and also Ref. 11, pp. 160-167. 
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where 



r = the cost of capital (the interest rate) 
n = the useful life of the initial outlay. 

The capital recovery factor (or "annualizing" factor) will 'je denoted 
a (r, n) . Thus 



r(l + r) 
a(r/^) = — — 



(1 r)'^-' 



If (n^), i = 1, . . ly represents I different capital costs with 
different useiul lifetimes, n^, the equivalent annual cost of the sum 
is given by 



ya(r.n ) K (n ) 

i=i ' ' ' 



If in addition there are J recurrent costs, Rj, j = 1, • . J, the total 
annualized costs, TC, is given by 



T;a(r,n ) K. (n. ) + Vr^ 
iTi ^ ^ ^ ^TiJ 

This is the general formula used in this study to obtain annual costs 
for media systems. The value of r used was ten percent. See Ref. 11, 
pp. 167-173, for a discussion of factors affecting the choice of r). 

The useful lifetimes of various fundamental cost components were 
wade compatible across the media systems. The most generally used in 
the detailed calculations are listed in Table B-4» ^he lifetime of 
three years for locally produced courseware is based op the average 
practice of the major local districts using instructional tr^levision;!^ 



TC = 
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Table 5-4 



USEFUL LIFETIMES OF STANDAIU) COST COWPONENTS 

Lifetime 

(years) ^ Component ^ Comments 

Variable Film and lilmstrip projectors - Based on hours of use 

3 Locally produced courseware Computer programs Tiay be up- 

dated at the third year with- 
out complete rewrite and used 
for three more years 

5 Commercially produced courseware For example^ delivery trucks, 

and certain equipment film inspection machines, TV 

sets, videotape machines 

10 Initial planning 

10, Initial teacher training 

10 Installation costs 

10 Most major equipment * For example, computers and 

outfitting of facilities 

25 Buildings 
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it reflects obsolescence of content rather than wear and tear.* Five 
y^ars for commerciairy produced courseware is a reasonable, assumption 
v^idely used and explicitly quoted for several cf the media (Ref . 1^ 
p* 206 and Ref. 13, pp. 482 and 486)* Ten years' lifetime for initial 
planning, training, and equipping facilities reflects the commi-^-ment to 
the use of media that each district is assumed to make in this t^tiidy. 
The lifetime of buildings is based on convertibility to alternative uses, 
rather than an assumption of duration of the media program in its origins ^ 
form. 

Five major types of media listed on the first page of this appendix 
were examined using the above methodology. Each of the media was costed 
TL^or separate oneration. The use of two different technologies simulta- 
neously (e.g., 20 min/week eav,h of a television based system and 16mm 
film) in a specified environment would cost approximately the sum of the 
separate media costs, perhaps lessened by sharing of certain initial and 
recurrent costs such as planning, train .ng, facilities, related materials, 
and administration. In contrast, sav^ings can result from the Joint use 
of two systems within the same technological group. Thus, for example, 
sound-f f Imstrip and i6mm film can share the same distribution systou and 
many features in productLaji and presentation — instructional material 
centers, classroom equipment, and staff " training among others. Santa Ana 
relays broadcasts of "Sesame Street" and "The Electric Company" from the 
local UHF television station into the classroom via its instructional 
television network.® 



The Sources of Data 

Two principal references were used. to construct the cost e. vimates 
for film and television. For fil^a the reference was the original GLC 
study,! significantly updated with market data and price lists on the 
costs of hardware and courseware. For television based systems, the 
reference was a partially updated (to 1972) version of the GLC television 
estimates contained in a nZvi report (Ref. 3, especially Appendix A) and 
subsequent verification of certain price estimates with equipment sup-* 
pliers and manufacturers. Further efforts here were directed at improving 
the estimates for instructional television production, which had not 
been updated, and at obtaining comparative data and an Intuitive under- 
standing of the operation of three local district, instructional television 



The importance of this point was stressed in private conversatiorxs in 
November 1973\ith Mr. John M. Sweeney of Education Turnkey Systems, 
Inc., Wfishlngton, D.C. 
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networks. As stated above^ these were at Anaheim and Santa Ana, California, 
and in Washington County, Maryland. It was during these activities that 
the extent of districts' unwillingness or inability to spend time and 
resources to keep accurate data on costs and effectiveness of instruc- 
tional systems, even when such data might be favorable or lead the way 
to further improvements, became fully apparent. 

For the three remaining technologies (programmed text, computer 
based instruction, and sound~f ilmstrip) no such comparable estimates 
were available. Thus it was necessary to calculate them in full detail, 
using a wide array of journal literature (inside and outside of education). 
We used (1) market reports such as the 1972 survey of the Educational 
Media Producers Council (2) catalogs and directories such as the 1973-74 
Audio-Visual Equipment Directo'-y,* which was also used to update som.e 
GLC estimates for film and television; and (3) extensive telephone and 
personal discussions with media producers such as Science Research Asso- 
ciates, Chicago (for printed programmed instruction), Coronet Instructional 
Media, Illinois, and Guidance Associates, Inc.^ New York (for film and 
sound-film St rip prices). Finally — and most necessary and rewarding in' 
that rapidly moving field — we employed telephone contacts and personal 
interviews (often multiple interviews) with officials of eight computer 
companies (including IBM, San Jose; Sperry, Chicago; Computer Curriculum 
Corporation^ Palo Alto; and Hewlett-Packard, Palo Alto) and four user 
orgaiiizations (including the SRI Computer-Assisted Instruction Group). 



See Re*^. 15 — sound-f ilmstrip, pp. 46-57; 16mm film, pp. 4-22. 
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Appendix C 



T^E USE OF EDUCATIONAL TECHNOLOGY 
IN THL PUBLIC SCHOCI^\, 1973— A PILOT STUDY 

No matter how revolutionary the potential of educational technology 
is for the development of public education^ it remains just that^ a 
potentially revolutionary force, until it is integrated into the philoso- 
phy and curriculum of the local school. In a p.reliminary effort to 
assess the impact of technological developments in the i.ast ten years^ 
a small subsample of the 230 districts studied intensively from 1961 to 
1963''- was ievisi*ced duringr late August and early September by Harry 
Kincaid, Norman McEachren, and Dorothy McKinney of SRI and Eleanor 
Godfrey, formerly of the Bureau of Social Science Research (BSSR), and 
now at Northern Illinois University. Eleven school systems at ten lo- 
cations were visited. Because time and funds ';;ere short, they were all 
located in two states, seven in California and fcHir in Illinois. Ten of 
the eleven sys-^ems had participated in all three phases of the original 
BSSR study; the eleventh is a sister secondary district for one of the 
elementary districts in the original California sample. The subsample 
included systems that were large and small, single level or K to 12, 
stable or growing, rich and not so rich, and covered the rainge of pre- 
vious attitudes toward educational technology from indifference to in- 
novative. A summary of district demographic characteristics is given 
in Table C-1. 

Although the districts differ widely in size, type, location, wealth, 
grov/th, and previous experience with educational technology, there are 
marked similarities in their curx'ent audiovisual programs and plans. 
This similarity within diversity suggests that findings from the pilot 
study may be indicative of some important general themes in public school 
education. However, a full scale restudy is advisable to test our 
hunches. One further caution is in order. Both California and Illinois 
are relatively wealthy states, ranking fifth and sixth in per capita 
personal income in 1970. Both also have a history of strong support for 
education. With the possible exception of New York and Connecticut, 



^Eleanor P. Godfrey, The State of Audiovisual Technology : 1961-1966 
(National Education Association, Washington^ D.C., 1967). 



ERIC 



C-l 



Table C-1 



RANGE OF DEMOGRAPHIC CHARACTERISTICS AMONG THE SAMPLE DISTRICTS 



Characteristic 



Size 

Number of schools 
School organization 



Range 



450 to 18,200 students 



1 to 45 



Elementary only (5), second&ry only (2), 
unified (4) 



Locations 



Sparsely settled mountainous county, rural farm, 
small town, university city, small city, suburb, 
metropolitan . 



Student growth 



From an 8 percent decline to an 88 percent 
growth in enrollment from 1963 to 1973 



Current expenditure per 

pupil $675 to $2, 100 

Instructional materials 

expenditure per pupil $5.50 to $66.00 



One of the originajl elementary districts has become a unified district 
since 1963- However, for the purposes of inventory comparisons in this 
study, only the current elementary figures were used* 

Numbers in parentheses indicate number of schools visited. 
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interest in and use of educational technology should be greater in these 
two states than in the nation as a whole. 



Each of the eleven districts was visited by one or more persons. 
Interviews were conducted with superintendents^ assistant superintendents, 
audiovisual directors, and librarians, A flexible interview guide was 
used aimed at: 

• Updating the inventory of audiovisual equipment, 
materials, and facilities, \^ 

• Assessing the present and potential use of the raore\ 
sophisticated educational innovations — specifically, the 
language laboratory ; broadcast , closed cixouit, and cable 
television; and computer managed and computer assisted 
instruction (CAI). 

• Gathering infoarmation on usage of new developments in 
*'older" media, particularly the cassette tape recorder, 

single concept filmstrip viewer, and 8mm projector, J 

• Ascertaining sreneral administrative attitudes toward 
the place of technology in education, the problems 
encountered in media use, and the role governmental 
agencies should play in the development of educational 
technology. 

Our findings in each of these four areas are discussed in this re- 
port . 

Change in Audiovisual Resources, 1963 to 1973 

Our first task was to measure inventory changes since 1963, Before 
we did this, however, it was necessary to compare the inventory holdings 
of the subsample with the larger national sample studied in the sixties. 
This comparison supports the caution that California and Illinois districts 
may be more richly endowed than the "typical" school system. In all 
instances except the opaque projector, the teacher/ equipment ratios for 
the subsample in 1963 were well beloW the average for the national sample 
at that time. 

Our analysis of inventory change addressed itself to two questions. 
Have the districts visited this summer increased the am lunt of audiovisual 
equipment available for classrocnn use? Which devices ai ^ currently most 
widely distributed? Data on these questions, as well as a comparison of 
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teacher/ equipment ratios for the national sample and the subsample are 
summarized in Table C-2. 

The answer to the first question above is clearly yes. Taking the 
ten districts for which 1963 inventory figures were available as a whole, 
there has been a substantial, even spectacular, reduction in the number 
of teachers per unit of equipment for seven of the eight items included 
in the 1963 survey.* The only exception is radio, which has virtually 
disappeared as a standard educational tool. As half of the districts 
did not carry radios on their inventories, no 1973 teacher/equipment 
ratios were computed for this medium. 

Dramatic as increases in total inventories may be, the increasing 
uniformity of teacher /equipment ratios across districts has more far- 
reaching implications for insti^ction. Increasing homogeneity of holdings 
was most notable for the tape recorder, overhead projector, and record 
player. Another important finding was the emergence of the individual 
filmstrip projector. Very few of these singlfj purpose machines were re- 
ported in the 1963 national survey, and only three of the sample districts 
reported any of this equipment at that time. By 1973, however, these ten 
districts reported 1,765 units, or enough to provide, on the average, one 
for every 1.6 teachers, with a district range of 1.1 to 10.0. 

Further evidence of the increasing leveling out of resources is 
provided by a district -by-district comparison of inventory increases. 
There were 53 instances in which we had inventory figures for both 1963 
and 1973. There was a decrease in teacher /equipment ratios in 43 of 
these 53 possible copiparisons . The ten instances in which there was an 
increase in the number of teachers served by a piece of equipment were 
16mm projectors (2), combination slide-f ilmstrip projectors (4), radios 
(2), television sets (1), and opaque projectors (1). For all other items, 
each of the districts, regardless of size or organization^ had been able 
to improve the relative amount of equipment available to the teacher. 

Comparison of the subsample with the national sample shows why these 
districts should not be taken as representative of the "typical" school 
system. In all instances except the opaque projector, their average 1963 
teacher /equipment ratios were well below the averse for the national 
sample. 



While the term "teacher" is used throughout the report, the ratios are 
computed from figures for "certified personnel" which may include prin- 
cipals, supei'visors, librarians, ai>d psychological and guidance personnel. 
Ratios computed on this base are a conservative estimate of the number of 
teachers served by a piece of equipment. 




tli 



*Plgure8 in ftarehthoses ate the highest 
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Ten years ago the workhorses of educational technology were the 
record player, 16mm projector, slide-f ilmstrip projector, and tape re- 
corder. In 1973 the individual f ilmstrip viewer and overhead projector 
had joined this stable. The most popular type of tape recorder was also 
changing, from the large reel-to-reel model to the small portable cassette 
type. 

Acceptance of More Technologically Sophisticated Media 

Three of the more sophisticated technological systems available for 
educational use are the language laboratory, the television set (open 
broadcast, cable, or closed circuit), and the computer. A review of the 
experiences and plans of the 11 districts visited this summer suggests 
several common themes about the good and bad instructional points of each 
of these systems. 

Language Laboratories 

The language laboratory was ^^the" educational technological innova- 
tion in 1960. Forty-five percent of the 2,927 districts participating 
in the first BSSR study planned to develop the use of this medium in the 
next few years. Respondents in our small subs ample were not quite so 
conv inced of the po^ en t ialT^vnarue ~of^ a langu age— laboratory , _ part icu lar ly 
the elementary districts, but even so foiir of the ten districts planned 
to install them, and by 1963 five districts had done so. (Comparisoa of 
the rank order of desirability for selected media for each of the three 
survey years is given in Table C-3. This table will be referred to through- 
out the ensuring discussion.) In 1973, enthusiasm for the language labora- 
tory had declined to the point that two of the systems had been destroyed; 
three other districts were planning to deempha^ize their use; and no one 
interviewed was optimistic about their educational potential. Why? In 
^he words of one superintendent, the Ismguage laboratories had ''phased 
themselves out." Critical reasons given for their demise were technical 
problems in operation, expense, overselling, and inflexibility. 

Another inflexible, precoded system, the teaching machine, has met 
a similar fate. A third of the nati'^nal sample and half of the subsample 
were interested in this innovation in 1961; interest held through 1963, 
particularly for programmed text materials; but in 1973 the only pro- 
grammed materials mentioned as desired were graded reading programs— -a 
very distant cousin of the original implementation of Skinnerian learning 
theory. 
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Television 



Broadcast television was literally hovering over.the educational 
horizon in 1961. Midwest Program on Airborne Television Instruction 
(MPATI) was about to become airborne. Educational television stations \ 
were operating in most of the metropolitan areas. And Hagerstown 
heralded the future technological age. Today^ MPATI is gone and the 
Hagerscown experiment collapsed with the withdrawal of outside funds. 
Respondents uniformly complained of poor reception^^ inadequate programming 
and inflexible scheduling on educational television; yet, five of the 
eleven districts plan to increase their use of television ^n the future. 
The seeming contradiction is resolved when we look at how the medium is 
used. Direct broadcast television is still the unchallenged instant 
medium for events of national or local significance, and the increasing 
availability of cayAe^ookups makes local reception less problematic. 
But the ^most promising future for television seems to lie in its adapta- 
bility for local production through the use of video tape. -Quality 
programs can be taped off the air to be used^ at the teacher's convenience. 
More importantly, television can be used as one respondent put it, es- 
sentially "as a mirror — a way of seeing ourselves. " The increasing 
portability of television equipment and the use of erasable tape means 
teachers filming themr;elves, learning from the film, and destroying the 
evidence; students filling a* play, a role-playing situation, a class 
discussion, whatever the needs of the moment; filmed laboratory demonstra- 
tions that bring each student up to the microscope; individualized visual 
instructions and personalized examinations to be studied in the privacy 
of a ptudent carrel. Seven of the eleven districts h^e used tele'/ision 
in siich ways, and all are enthusiastic about the potential of such use 
in the future. ^ 

The Computer 

All of the districts, except two small single school elementary 
districts, have access to a computer. Seven have used it, with varying 
degrees of satisfaction, for scheduling, printiuK audiovisual catalogues, 
and general bookkeeping chores. Six have experimented with computer 
asfsisted instruction. While it is too early, and the data are too meager, 
to forecast the extent to which the computer will be incorporated into 
the instructional life style of the public schools, certain similarities 
and dissimilarities witli other machine oriented learning systems should 
be noted. 

CAT is a complicated system requiring elaborate supporting machinery ,^ 
highly trained personnel, and specialized materials. The drawbacks of 
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cost^ technical problems^ inflexibility, and oversell were cited by 
several of the respondents, both those who aad aiid those who had not 
experimented with CAI. Sequential programmed learning is currently held 
in disdain as the best method to teach most subjects* As a Director of 
Curriculum Planning put it, '*If the content is logical, the computer can 
facilitate instruction, but much instruction is not of this character. 
It is best used in special applications, such as the expansion of a 
motivated gifted student's knowledge in a logically organized subject 
area such as mathematics or science/^ 

The theme that the computer is most suitable for challenging and 
motivating the gifted student in mathenatics and science ran throughout 
the interviews. Only one administrator spoke of its utility as a patient 
tutor for the slow learner. Only one made a case for its use with the 
''middle 3/4^' of the student body (except to teach them computer usage). 
His district uses the computer to teach mathematics, reading, and driver 
edu cation » 

The grade leval at which the brilliant student should be introduced 
to the conputer was somewhat at issue. Some advocated CAI for the 
elementary student, who could then go as far as his interest and ability 
would take him, without surpassing his impersonal 'teacher.'' Others 
felt it wa;^ most suited to the secondary curriculum, where there is less 
need for drill and practice and where the ouujcct matter is more logi- 
cally structured. ' 

The computer has been welcomed cordially as an administrative slave, 
and used as such wherever access could be arranged without too much 
technical difficulty or cost* Some districts have experimented with the 
computer as a data managing device; e*g., hooking into data retrieval 
«3ycjt*»tTiR or preparing a data bank of examination questions from which to 
draw Individualized tests; They do not seem as sanguine, however, about 
its^direct instructional capabilities* The computer can provide a myriad 
of individualized instructional" programs, a (capability not present in 
previous machine systems; neverthe3 9Ss, the cost, elaborate support net- 
work, and limited envisioned target audience suggest caution. Once burnt 
by highly touted sophisticated instrucL* ional r.edia, twice shy. 

The other trends, one related to the structure and governance of 
education and the other related to instructional emphases, can seriously 
influei^e the development, of CAI, First, there is a groundswell for in- 
dividual autonomy for each school in a system in various parts of the 
country. Several of the subsample districts have delegated, or are in 
the process of delegating, curriculum and budgeting decisions to the 
individual schools. The large investment of money and personnel required 



for a viable CAI program demands a high level of cpimnitment from all 
parties to the agreement. Whether or not individual principals and ^ 
faculties^ who have just begun to taste the fruits of independence^ will 
be willing to make any such lajpge scale commitment to computer instmc- 
tion is questionable. A case would have to be made for how such an in- 
vestment, rather than one^ in higher salaries or more personnel, would 
benefit the teacher as well as the student, A resurrection of teacher 
fear of displacement, kindled earlier by the post-Sputnik emphasis on 
master television teaching^ filmed courses, and expert designed sequenced 
programs would be disastrous not only for CAI but other forms of educa- 
tional technology. And teacher militancy has given teachers courage to 
voice their opposition to any threat to their autonojp.2A and primacy in the 
educational structure. 

The second development is related to the current emphasis on teacher 
accountability, but accountability for the progress of a different group 
than that foreseen as the priniary target population for CAI. The predicted 
oversupply of scientists and college graduates and the demands of the 
dis^d^amtaged for ah adequate education relevant to their life situation 
have dappened the enthusiasm for special programs for the gifted, which 
was ne^r as robust as ^ that for programs for the handicapped,, Individual- 
ized instruction is advocated not so much for now it can challenge the 
gifted, as for how it can meet the needs of the "iorgotten 20%" who cur-- 
rently find education irrelevant or incomprehensible* l^e maxim of the 
day is success for every student, meaning success for the student who 
previously has^ failed. Accountability objectives are written in terms 
of minimal acceptably levels of achievement for all or' a large portion 
of the students. Perhaps there is a lesson here for th')se who would 
promote CAI. Currently it is viewed as an effective teaching device for 
the gifted mathematician or scientist. tJnless its utility as a tool for 
the masses can be demonstrated and emphasized, it may well run into both 
teacher and taxpayer resistance. Failing that, its widest immediate 
utilization appears to be as a data m^agement and i^etrieval system for 
the administrator and teacher, not as a medium for direct instruction. 

Accept fitnce of New Developments in Standard Media 

Comparison of equipment inventories with earJier years shows sub- 
stantial increases in the numbers of overhead projectors, cassette tape 
recorders, individual filrastrip viewers,] and 8mm projectors* What 
hypotheses csai our interviews suggest concerning the high popularity of 
these items? ' 
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The Overhead Projecto r 



This device, a spin off frcMn^ the more cumbersome and less versatile 
opaque projector, proved to be the most widely accepted technological 
innovation of the sixties. In 1961^ there were an estimated 14,000 in 
the public schools, or one for every 107 teachers. In 1963, the teacher/ 
equipment xatio had dropped to 37.6, and the overhead projector stood 
first on the list of most desired equipment. Eighty-two percent of the 
238 district administrators surveyed at that time stated that they planned 
increased use of the overhead projector in the future. Current teacher/ 
equipment ratios for the subsstmple bear out this intention. The average 
number of teachers per projector dropped from 28*9 to 3,2'^ and the range 
by district shrank from 14.4-299.0 to an Swazing l«6-5.3. A pesrusal of 
future plans for the eleven districts suggests that the overhead projector 
may be approaching a saturation point. It was most desired in 1961, 
dropped to second plaq^ in 1963, an<i"vto fifth place in 1973 (see Table 
C-3). Vfhy did the overhead projector succeed so dramatically when zhe 
teaching mach:^.ne', in second place for the subsample and in fourth place 
for the natiolial sample in 1961, did not? Differential relative cost 
per unit of instruction is a facile but, I think, erroneous answer. 
- Teaching machines were getting cheaper and cheaper throurrhout the halcyon 
boom days of the early and middle sixties. Both devices wer^ plagued 
by a dearth, of high quality commercially prepared materials; but for one 
this was a curse, for the other a blessing in disguise. 

The ordinary teacher coul^ do nothing about the lack of prepa]?ed ^ 
sequential learning materials for the .machines, but he or 'Bhe coxld make 
somethin^^ to show on the overhead projector. The eleven dist^'icts have 
minimal or nonexistent libraries of prepared transparencies, yet they 
continue to buy overhead ^projectors. No one apologized for the use of 
the machine as a '^portable blackboard;'' rather, they extolled its versa- 
tility and individuality. Ingenious minds discovered acetate rolls, 
exposed x-ray film, and other inexpensive transparent materials on which 
to create their own visuals. The teacher, and eventually the student, 
could be creative, and an apparent anomaly is resolved. 

A final note on the teaching machine that may be instructive for 
the proponents of CAP/ One of the eleven districts, a wealthy suburban 
high school district, had been a demonstration school for both teaching 
machines and programmed texts- It found not only teacher resistance to 
programmed learning, but a "tiring factor" for the brighter student, 
particularly for linear programming. Teacher resistance and student 
boredom forced them to drop both programs. This district is still anti- 
pathetic to any precoded or highly structured instructional program. 
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Cassette Tape Recorders 

In first place in the rank order of desirability in 1973, chosen 
unanimously for increased use by all eleven districts, is the tape re- 
corder, particjlarly the. portable cassette type. Inventories of this 
item have mushroomed until there is now an average teacher /equipment 
ratio of 1.6, with a range of district ratios of 0,9-5.7, and much larger 
inventories are anticipated in the future. Tapes were ranked fourth in 
desirability for increased use in 1961, second in 1963, and first in 1973. 
In the words of one audiovisual director, interest in "capes is "running 
wild" with no apparent end in sight. 

Several reasons v/ere offered by the respondents for this* increasing 
popularity over a ten-year period. The cassette is ideally adapted to 
individualized instruction. The units are standardized so that a cartridge 
fjts many player models. Cassettes are relatively cheap, break proof, 
and erasable. A teacher or student can record a lesson, learn it, and 
erase it for another. A student can check out and use both the player 
and the cartridgi^ in the media center and, if he uses earphones, he need 
not disturb his neighbor. 

o 

Talking has always been the teacher's main tool. With a cassette 
tape recorder, he can record a lesson for later replay at the student's 
convenience. The fact that the teacher need not be present when the 
student replays the lesson increases the number of students who can be 
served in this way without a commensurate sacrifice of teacher time. 
Thus, the tape recorder provides the remedial tutoring and individual 
pacing for which the teaching machine was designed. With dual track tape, 
it also provides the "listen-speak-compare*' function of the language 
laboratory at a fraction of the cost. Indeed, the extant Isuiguage 
laboratories are essentially tape recorders with multiple earphone hook- 
ups, used for small group instruction. 

The cassette tape recorder may well replace its grandparent^ the 
record player, as the portable television camera and video tape are 
replacing the radio. Most of the districts in the subsample are buying 
more tapes than records, and several are transferring their record col- 
lections to the more indestructible cassette as rapidly as resources 
allow. One district employs a technician to monitor and transfer quality 
radio broadcasts to tape. 
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The Individual Filmstrip Viewer 



The large single purpose filmstrip projector had essentially been 
replaced by the combination slide-f ilmstrip machine in the early 1960s. 
So few filmstrip projectors were reported in 1963 that they were not 
discussed ks a separate inventory item in the report of that survey. 
The subsample was no exception to the general pattern at that time; only 
three districts reported this equipment^ and then only in token amounts. 
In contrast^ this summer {here were enough filmstrip/projector /viewers 
in the districts ta^nroyide a teacher /equipment ratio of 1.6, with a 
district range of L 1-10.0. 

The major factor in this reversal oj a downward trend seems to be 
tho development of a cheap, simple, portable viewer • Again^ like the 
cassette recorder, we find a machine suitable for individualized learning 

simple enough lor a small child to operate. Filmstrips can be cnecked 
cut of the media center for indivi^.dual study^ or children in the classroom 
can pursue different lessons individually and silently. A reasonable 
quantity of cheap acceptable materials is available and, if not found in 
the district library, can be purchased by the individual school or teacher 
cut of discretionary funds* Combination kits of filmstrips, records^ 
or cassettes, and even pictures are available and purchased in increasing 
numbers. The large districts produce some filmistrips tailored to an 
individual teacher *s needs* 

Although locally produced software is not yet available in large 
quantities, the filmstrip projector /viewer is portable, cheap, and easy 
to operate, and is suited for small group or individualized instruction* 

The 8mm Projector 

Both the 8mm sound projector and the 8mm silent film loop machine 
have grown in popularity since 1960. The superintendents surveyed in 
1961 reported very few 8mm sound projectors and little interest in incor- 
porating this projector into their program. The item wiis carried in the 
1963 survey, again with no evidence of any current or anticipated use. 
Typical of the national sample was the fact th^t only one 8mm sound 
projector was reported by ten subsample districts for that year. By 
1973, however, there were 54 8mm sound projectors and at least 47 film 
loop machines among those sample districts. Unfortunately, our intezview 
guide did not ask specifically for film loop machines, so the number 
recorded for this equipment may underestimate the current inventories. 
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Again we find, at least within this pilot study, a resurgent 
interest in a previously quiescent machine. The 8nun projector now ranks 
second behind the tape recorder in plans for increased use. Our in;ler- 
views suggest several possible reasons for this renuissance. The single 
concept film loop, like the filmstrip, is simple to handJe and tailored 
for small, jroup and individual learning. The increased interest in the 
Smm sound projector may be coupled with a similair interest in the 8mm 
camera, which can be used for local production by faculty and students. 
Commercially prepared films are available for courses, such as career 
education and driver training. 

Administrative Attitudes Toward Educational Technology 
Interview Questions 

A series of interview questions tried to tap administrative attitudes 
about the correct use of various kinds of educational technology by 
asking how and where audiovisual materials had been used most effectively 
in their school systems; the problems they hsid encountered in using 
media; which media were most valuable and which had been oversold; what 
role federal, state, and county agencies should play in the field of 
educational technology; and what they would drop in a "budget squeeze" 
or add if they received a grant. 

Productivity, Priorities, and Governmental Role 

Most of the administrators and their school boards were concei*ned 
with productivity and demands for cost effectiveness, program budgeting, 
and school and teacher accountability— a concern that was perhaps par- 
ticularly acute in California where the state has mandated program 
budgeting and teacher accountability. With possibly one exception, 
however, these administrators did not look to educational technology as 
the way to raise productivity without increasing costs. The respondents 
were unanimously of the opinion that the teacher was primary and essential. 
Educational technology was '^supplemental, but not cheaper.'' Good tech- 
nology, wisely used, could increase the quality of the education offered, 
but not bring about a reduction of costs. 

The adjunct status of educational technology was further attested 
to by the answers given to the question, "If you were in a budget 
squeeze, what items in order of priority would you drop? Would you 
increase or decrease the use of im^tructional materials?" The answers 
to this query were not as hypothetical as the question wording might 
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suggest. Districts in both Illinois and California have experienced one 
or more lean years in the recent past, and several of the suggested cuts 
offered are ones that were actually made when the district was quite 
literally in a budget squeeze. 

Answers to the question substantiated the "add on" nature of educa- 
tional technology, Noncategorical and deferrable budget items are the 
first to go in a recession, and educational technology is clearly vulner- 
able on both counts. The order of priorities for cutting were capital 
outlay for new equipment and expensive materials, staffing and stocking 
media centers, and development of new programs such as cable or closed 
circuit television and CAI. If the cut were deeper, some nonteaching 
and marginal personnel (e. g. , part-time librarians, music, and art 
specialists) would be eliminated. Hopefully, instructional materials, 
other than expensive outlays and duplicates, would be the last items to 
be cut. 

Conversely, a special grant would be used first to develop and staff 
a media center and second to provide more technical support personnel and 
local production capabilities. Only after these needs are met, would 
most districts consider initiating expensive new programs such as cable 
television hookups or CAIp 

The federal government, and ^ondarlly the states, were seen as 
the proper agencies to underwrite ensive program developments like 
PLATO and those produced by the F *^est Regional Laboratory. The 
federal government should also continue Title I and Title II grants, 
but reduce the amount of busy work involved in preparing grants and the 
amount of bookkeeping necessary to account for grant funds* It was also 
strongly suggested by one district director that the federal government 
would be well advised to allow more personnel costs in grants and under- 
write training programs for technical personnel: "A lot of money was 
wasted under the National Defense Education Act (NDEA) and Title II be- 
cause there wasn't the trained personnel in many local districts to see 
that the equipment and materials purchased with federal funds were used 
effectively/' The desire for more trained personnel was echoed by 
several district administrators who thought that federal and- state agen- 
cies would be wise to spend money on consultants, workshops, inservice 
training programs, and evaluation studies of their own programs and of 
new products. The respondents envisioned a kind of consumer report 
service that would test technological innovations in real school settings 
and report to the local district what works and why. 

No one wanted direct participation by either federal or state 
agencies in local school affairs. These agencies might underwrite. 
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guarantee papport levels, develop, test, evaluate, train, and advise as 
long as "they stayed out of the curriculi m'' and "allowed che local 
districts to go off on their own." Like educational technology itself, 
federal and state involvement should be supplemental. 

Even less involvement was wanted from county agencies beyond the 
provision of a materials library, particularly for small districts. 
Most of the larger districts would rather go it alone and saw no way 
in which a county or regional consortium could help them , aside from 
possible cost sharing for expensive equipment and materials. And these 
needs would have to be impelling to overc<Mne the serious drawbacks of 
multiple decision makers, the possibility that their requests would not 
be honored, and increased bookkeeping chores. Even small districts that 
must depend on a cooperative library for most of their films complain 
about inaccessibility of county facilities for preview and production 
of materials, booking delays, and failure to have their own needs ade- 
quately met. 

With such an emphasis on local autonomy at the district level, it 
is not surprising that individual schools are seeking autoncmiy from 
their "consortium.'^ 



Overall Assessment 

Death, taxes, and problems in utilizing educational technology are 
always with us. In 1964, I wrote that "educators at all levels encounter 
problems which hamper the effective use of audiovisual materials. There 
is never enough money; projection conditions are far from ideal; films 
do not arrive on schedule; some teachers fail to see the value of audio- 
visual technology (and use it inappropriately); or the added- burden of 
preparing materials for classroom use is just too much to fit Into an 
already crowded schedule • • . and there is a shortage of relevant 
materials." According to our respondents these problems still plague 
the local district. Compoundixig the situation today are the more fre-« 
quent breakdown of sophisticated equipment, lack of local production 
facilities, lack of technical expertise, and the possibility of copyright 
infringement in reproducing materials locally. 

Despite these formidable obstacles, the districts are increasing 
their Inventories, experimenting with new media and new uses for ojd ^ ^ 
media, and encouraging local production. A few voiced concern that 
local production by nonexperts would be of inferior quality, but most 
felt that the creative involvement of both teacher and student in such 
efforts outweighed the quality defects. They do not advocate that 
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teachers go into the production of feature films, but encourage them to 
make transpai*ancies, tapes, slides, ephemeral video tapes--anything 
that will "help the individual child learn/' Almost all of the reported 
examples of effective use referred to Individually created materials or 
novel uses of media« 

The enthusiastic see educational technology as a way to reach. the 
child through many senses on many levels and as a way to free the teacher 
to fulfill the professional role of a manager of learning resources and 
expert tutor. The less enthusiastic see educational technology as an 
add on, most useful for supplemental enrichment or motivation. Perhaps 
a general theme running throughout the interviews can be summed up in the 
words of one administrator: ^'Educational technology is aiwd.ys supple- 
mentary to the teacher and the curriculum. Technology that is totally 
preprogrammed :>eems to be overrated. You can't adapt it to your own 
needs and special circumstances. Good technologies include: self--^ 
instruction and individualized instruction, and those devices which are 
complete within themselves, and do not have to be used with elaborate 
supporting machinery equipment, and/or materials. Also, materials and 
media that allow for the creative inputs of local teachers are very good." 

" What is the state of audiovisual technology in 1973? What direction 
might it take in the future? Vrhat policy implications can be drawn from 
answers to these two questions? Eleven cases from two states is much too 
restricted a sample for any firm conclusions about the current state of 
affairs. However, certain developments and themes, if confirmed by a 
broader based study, have important implications for the future: 

• An apparent turning away from complicated, prepackaged 
systems in favor of simple devices suited for local 
production and student manipulation, 

• An emphasis on individualized media tailored to the 
Instructional needs of a group of students seen as 
heterogeneous in talents, interests, and knowledge, 
rather than as a "fourth grade*' or "freshmen English 
class. 

• A counter trend toward accountability for the achieve- 
ment of some minimum standard of proficiency by all, or 
nearly all of a "class." 

• A trend toward individual school autonomy in curriculum 
and budgeting. This decentralization, coupled with rising 
taxpayer resistance to continually rising school costs, 
despite declining enrollments, does not presage a receptive 
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climate for the rapid development of sophisticated tech- 
nology. Even with massive outside support, such develop- 
ment might be counter to the educational mission as seen 
at the local level. 

An extension of a concept of autonomy is the teacher *s 
demand to be recognized as a professional capable of 
directing his own work, without interference from 
district, state, or federal administrative personnel. 
Almost all of the respondents alluded to the final 
decision-making power of the teacher in whether and 
how educational technology will be used. You can 
"make the bait available,^' but whether or not it is 
accepted is up to the Individual teacher. 
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Appendix D 

PROCEDURES FOR THE INVENTORY OF FEDERAL R&D 
IN EDUCATIONAL TECHNOLOGY « 




' pap9t>8 "on the t^roje^t*? involving 
fell ' • «Jot«woi*thy. So, wthoygh the 



lofbiwation w0 goC'froru tho information 



Jv-i'!''*'' I' <l9Uro« o| data, \ 





The following tabulation indicates the number of projects sponsored by 
each agency in the area of educational techiiology, according to the 
Smithsonian Inforination Exchange* 



Number 

Agency ' of Projects 

Office of Education 293 

National Science Foundation 70 

Department of Defense 39 
National Institutes of Health and 

Public Health Service 

Social and Rehabilitation Service / ^6 

Veterans Administration r 3 

Department of Commerce 2 

Department of Transportation 2 

National Aeronautics and Space Administration 2 

Department of Justice 1 

Office of • Economic Opportunity . 1 

Executive Office of the President 1 

Department of^ Labor , 1 



Total - • 446 



■ \ 



The three major supporters o:^ research on educational technology were 
^hosen for closer examinatiogrf : The Office of Education, the National 
Science Foundation, and the Department of Defense* While the SIE data 
Is demonstrably inpomplete, "we assumed that the foregoing distribution 
was sufficiently accurate for the decision on scope* 

Information on the Office of Education's activities was from* the 
Projects and Grants Information System (PGIS) ; information on the Depart- 
ment of Defense was from the Defense Documentation Center (DDC) ; informa- 
tion on NSF activities was from the Annual NSF Grants and Awards publica- 
tion. The latter contains less information on each project than does any 
other source; therefore, our information of NSF activities is necessarily 
more scanty. However, there is reason to believe the NSF data is more 
complete than the data available from OE and DoD. * 
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Procedures for Ac cesslng Information Serviceg 



In order to ask these sources for the project listings they had on 
educational technology, we had to specify key words. Not all of the 
information systems use the same set of key words, so the list of key 
words was necessarily different for each Information service. Each set 
of key words was developed in consultation with specialists from the 
several services. The total list of all of the key words that we used, 
classified by source, follows: 

• Smithsonian Information Science Exchange (SIE) — Audiovisual aids 
(nonspecific) , computer-assisted . instruction, films , programmed 
instruction and teaching machines, televisionj» simulation in edu- 
cation, training devices and aids (includes satellite and radio). 

• Educational Resources Information Center (ERIC) — Instructional 
technology, educational technology, computer assisted instruction, 
instructional television, educational television, and televised 
instruction. 

• National Technical Information Service (NTIS) — Programmed instruc- 
tion, teaching machines, computer assisted Instruction, computer 

' aided instruction, education or educational television, (education^ 
or educational) and television Instruction satellites, satellites 
and (instruction or education or educational) individual, instruc- 
tion and individual, audiovisual (library or libraries), and 
(education or educatibnal or instruction) and (library or 
libraries). 

• Projects and Grants Information System (PGIS)~Instructional 
technology, educatiorial technology, televised instruction^ pro- 
grammed instruction, computer assisted instruction, autoinstruc* 

, tional .programs, electrcMnechanical technology, telephone instruc- 
tion, computer oriented programs, multimedia instruction, media 
technology, media research, telecommunication, television, radio, 
educational radio, communication satellites, telephone communica- 
tion systems, dial access information systems, instructional tele- 
vision, educational television, television curriculum, telecourses, 
cable television, closed circuit television, airborne television, 
instructor centered television, fixed service television, video 
equipment, video tape recordings, films, instructional films, 
microforms, microfiche, microfilm, sound films, foreign lan^age 
films, documentaries, single concept films, projection equipment, 
photographs, filmstrips, slides, transparencies, photographic 
equipment, electronic classrooms, autoinstructional labort:tories , 
audio video laboratories, language laboratories, audio active 



compare laboratories ^ audio active laboratories, audio passive 
laboratories, language laboratory equipment, language laboratory 
use, prograirjned units, programmed materials, programmed texts, 
programmed tutoring, mechanical teaching aid?, autoinstructional 
aids, teaching machines, self pacing machines, autoinstructional 
.netbods, simulators, rames, educational games, classroom games, 
management games, simulation, tape recordings, phonograph recoro- 
ings, phonograph records, and audio equipment. 

Department of Defense (PoD) — Computer assisted instruction* 
Instructional films, programmed learning, educational radio, 
educational games, educational television, educational telecom- 
munications, teaching machines, electromechanical teaching devices, 
mechanical teaching aids, video instruction, audio instructi^ n, 
programmed texts, telephone Instruction, artificial satellites in 
education, electronic classrooms, language laboratories, and 
training. 

Also, for DoD, some specific organizational names within DoD 
were used to get work units from groups whose work lay largely 
in the area of educational technology. These Included U.S. Air 
Force Human Resources Laboratories, Naval Training Device Center, 
Human Resources Research Organization (HumRRO) , and Naval Train- 
ing Equipment Center. 



Procedures for Classifying Output 6f Information Services 

The use of these key words gave us a batch of abstracts from -each 
information dorvice. However, not all of these abstracts fell into whet 
we considered our scope. There were two main reasons for this: (1) the 
, abstract was of a project that was not ongoing during fiscal years "?1 
and '72, or (2) although the abstract was tagged with one of our key words, 
the research described was not primarily concerned with educational tech- 
nology/ For instance, a research project that concerned the integration 
of a school and was going to incidentally use a small portion of the grant 
to buy an item of educatlcnal technology was considered out of scope. 

Once we had eliminated the abstracts that were not within the «?cope 
of our effort, we tried to get as much Information as possible from the 
remaining abstracts. To do this, we asked u series of questions about 
each research project: 

• Which federal agency funded the research? 

• At what level of effort was the research funded? 
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What type of technology Was involved? 
What was the target audit>nce of the research? 
What was the grade level of the target audience? 
Who did the research? 

What type of project vas.it (e*g*, research, development, 
demonstration, evaluation) ? 

In what 3ubject matter was the technology used? 

A summary of the coding categories is presented in Table D-1. A 
detailed description of each cod^' appears below.* 

Funding Agency 

We found that the great majority of R&D projects on educational 
technology were funded by three agencies ; we are considering only these 
agencies. 

01 DoD: Department of Defense ! 

02 OE: Office of Education 

05 NSF: National Science Foundation i 

1 

. . ; 

1 

Type^ of Technology 

Software and hardware to be used together are r^rten In the some 
category; exceptions are transparencies (07) and overhead projectors (09). 

\ ♦ 

♦ 

The following two codes ^ amain fairly constant across all the variables. 

09 Miscellaneous/combination. In general, either something that was not 
cofflmon enough to have its own category, or a combination of cate- 
gories (ercept for type of technology) such as a project involving 
both teacher in-service and teacher preservice education. Where one 
category clearly predominated — e^g. , a college course with minor 
applications to high school studonts— the project was coded in the 
major category. 

10 Not applicable. Either the vari4^ble wai^ not relevant or applicable 
to the project, or it was In scMne way not codable; e.g., where there 
was no Information given in the abstract. 
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Table D-1 



EDUCATION TECHNOIXWY CODING CATEGORIES 



Grade Level, 37-38 



Funding Agency, 33-34 

01 DoD 

02 OE 

03 NIH or PHS 

04 SRS 

05 NSF 

06 Dept. of Commerce 

07 Dept. of Labor 

08 Executive Office of President 

09 NASA 

10 Not applicable 

11 Treasury Department 

12 Dept. of Agriculture 

13 Dept. of Interior 

14 KUdX 

15 Deptl\ of Justice 

16 GEO \ 

17 VA ■ 

18 Dept of State 

19 Transporatlon 

20 States 

21 University 

22 Foundation 

23 Foreign 

24 Congress 

99 Misc. , comb. 

Type of Technology, 35-36 

01 CAI 

02 ETV (videotape) 

03 Film 

04 Programmed Instruction 
05 

06 Tape recorder 

07 Slides, fllmstrip 

05 Other 

09 Miscellaneous 

10 Not applicable 
11 

12 Computer, noniustr. 

13 Radio 

14 Simulation 

15 Multimedia system 

18 Either 15 or 19 

19 Combination 



01 Elementary 

02 Secondary 

03 Post-secondary 

04 Elem and sec 
05 

06 Preschool 

C7 General audience 

08 

09 Misc.^ comb. 

10 Not applicable 

Target Audience, .40 



02 Handicapped 

03 Mentally 111 

04 Alcoholics, drug users ; 

05 Normal 

06 Bilingual 

07 Disadvantaged 

08 Retarded 

09 Misc. , comb. 

10 Not applicable 

Performer, 41-42 

01 University 

02 Private-profit 

03 State agency 

04 School 

05 Fed, govt. 

06 Private-nonprofit 
07 

08 

09 Misc. » comb. 

10 Not applicable 



Type of Activity, 43-44 

01 Research 

02 Lit. review 

03 . . ■ ' 

04 .Development/design/ 
production 

05 ^'^ononstration 

06 Evaluation 

07 Operations 
08 

09 Misc. , comb, 

10 Not applicable 

Fiscal year, 47-48 

71 1971 

72 1972 

73 1973 

74 1974 

Subject Matter, 49-50 

01 English 

02 Math" 

03 Social science 

04 Medicine 

05 CTAgineering 

06 Physical & natural science 

07 Foreign language 

08 Arts 

09 Misc* , comb. — classical 

10 Not applicable 

11 Nonclassical in school 

12 Nonclassical out of school 

13 Teaching methods 

14 Attitude change 

19 Combination, including 
nonclassical 
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-09 
06 

07 
08 



■ T«pe recorder i - ■ -l^pe^f ecorddr Wo^ tatws , ^-^rifii^imf^M^^S^^i. 
vofkttvidg*, and caesette. ' . ' , . -l.^ .i.-^i ? i^ivVTH;^^^! 

(may include aoxtnd 
not th^ ovVrhead 

Other: Thl$ iricludep >i?lf-«tU(}y 
only ae "Individualized inptrtieVl^^n. 



09 

11 
12 

14 



Miscellaneous J Taljclng tj^pewrlt^rsi 
overhead prb4eotors. 

This code not uised. ' 



Computer, noninstyuotionaM Computers for adrtittlstr^tipri j?^^^^^^^^ 
educatlon-lnoludes >eej>lng recprds of attendance_ 6^j<J ^**ff^'^r%S;ffl 
scheduling ci|B8es, counseling, and so on. J,:^':-^.---\Y'-J^^4iifi 



Radio 



simulation! .Simulation and gaining, « technique. for. lteltat|^0^^^^^^^ 
a specified situation Iti y^hich thf» actions ^^P^^^I^P^JtB^-^^^^^^ 
, Ihfluenc^ Htuatlbn^l^ent^, th^'gaiiie wayA^g^^ 
^' cir #:ef oral I people and >aay lhVolv6 a comfrtitdy.v for. th^ .nilUtai'y.r^^w 
' slbiuUtlon of ten uieanp imitating r.eal^llfQ wlUt^ry fi^Vf^J^?? ^i:W^€ 



that <^lil 
the danger 



probably ^rise -in th^e f ield V th'e >lm^l«tldh"«i^nln.Rte|^ 
.r to life aijd #ipm^nf arid- som& of the ex^nsif, -■'y'':':^^^:' 
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Multimedia system: A single coordinated system design in 
which several media are employed jointly in the same instruc- 
tional sequence toward the same instructional goal. 



19 Combination: Using more than one medium^ but not as an inte- 
grated unit. For example, a center that will develop ETV for 
one group of students, programmed instruction for another, films 
for another. 



Grade Level 

01 Elementary: Kindergarten to sixth grade 

02 Secondary: Seventh to twelfth grade 

03 Post- secondary : Higher educatAon and continuing education. 
Postdoctoral study, graduate study, or undergraduate study 
at a university, college, or Junior college; adult school; 
preservice and inservice training. After high school, dr 
after high school age , Basic education for adults (subjects 
they should have learned in elementary and secondary school 
but did not) is post- secondary. A 15-year-old enrolled in a 
college class on, a college campus is In post- secondary education* 

04 Elementary and secondary: Prc^raras involving both elementary 
and secondary grades (e.g., music appreciation for third grade, 
seventh grade, and tenth grade) or any project done in a unified 
(K-12) school district, where the abstract does not indicate 
whether it is for elementary or secondary pupils. 

06 Preschool: Children through age 5. Sesame Street, directed to 
3-5 year olds, is preschool. A program for kindergarte^n 
children would be elementary. 

07 General audience: The public at large; e.g., television pro- 
grams for home viewing. Also programs that might benefit 
several audiences. 



Target Audience 



01 This code not used. — 

02 Handicapped: Bl^nd^^ea^f , 'fmiteT^^ also physically ill 
Ce^g^-r^P^pT^^^covering from heart attacks) . 
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03 Mentally ill: Neurotics, psychotics, and psychopaths in 
mental hospitals, schools for emotionally disturbed children, 
institutions for children with behavior problems, and the like. 
Individuals threatening suicide. 

04 Drug users: Persons who abuse drugs, including alcohol. 

05 Normal : Catch-all category for any target group that was not 
singled out as being in any other category. Most teachers 
(intermediary target audiences) are coded as normal. 

06 Bilingual : People whose native language is not English. (They 
may or may not speak English.) 

07 Disadvantaged: People who come from different cultural back- 
grounds and so are at an educational disadvantage; e.g., inner- 
city" ghetto residents and Appalachians* 

08 Retarded: In general, any target audience, classified in the 
abstract as retarded. Occasionally, we used our own judgment; 
e*g, a target group called ''retarded" because the students were 
one year behind in reading achievement was coded normal. 

09 Miscellaneous, combination: An example is "exceptional," which 
includes the retarded and the gifted. 



Performer 

01 University: Any university or college or other Institution of 
higher learning. 

02 Private profit: Any company, corporation, or other nongovern- 
mental oi^anization for profit. 

03 State agency: Any government agency at the state level, includ'- 
Ing state boards of education. 

04 School: Public and private schools, school districts, and 
— ^-^ounty boards of education. 

05 Federal government : Any department or agency of the* federal 
government; e.g.. Office of Education, Department of the Navy. 
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06 Private-nonprofit: Nongovernmental organization not for 
profit; e.g., Stanford Research Institute, RAND Corporation, 
the Red Cross, Rocky Mountain Satellite Federation. 

07 This code not used. 

08 This code not used. 



T ype of Activity 

01 Research: Research on the basic variables underlying the use 
of educational technology and investigations into the useful- 
ness of certain types of technology.- Also other studies, 
frequently using the methodology of the classical experiment, 
with subjects i'andomly assigned to experimental and control 
groups to examine the effects of different types of technology. 
The experimental variable may involve technology only inciden- 
tally; e,r , research on the effect of discussion groups on 
learning in an audio- tutorial course. 

02 Literature review: State of the art reviews, literature reviews 
and conferences where educational technol<^y is the subject. ^ 

03 This code not used. 

04 Development/desigrn/ production: Development of educational tech- 
nology at any stage from program^^ desi^r^.^^^ testing 
and revision. Devel QpmenfTnay include some literature^^view 

or evaluation of the developed system or product. 

05 Demonstration: Putting an already developed educational tech- 
nology system into practice to a limited extent, for the purpose 
of modeling or display, with the interest that others will 
follow the example. 

• 

06 Evaluation: The critical testing and review of an existing 
educational technology program, or the use of educational tech- 
nology in evaluation; e.g., the use of videotape in 'micro- 
teaching'* for teacher evaluation. Includes only those projects 
whose main purpose Is evaluation. 
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07 Operations: Financially backing an ongoing educational tech- 
nology activity; e.g., funding the operation of (and/or the 
expansion of) an educational radio station. 

08 This code not used. 



Fiscal Year 

We used fiscal years rather than calendar years. A project going 
on in more than one fiscal year was coded as a separate project for 
each year in which at least one-half month was spent on the project. 
For example, a project from June 29, 1971, to September 29, 1971, would 
be coded once for FY72 ; a project from June 15, 1971, to September 15, 
1971, would be coded once for FY71 and once for FY72. We coded for the 
fiscal year in which the project was done ("start date" and "end d^te") — 
not when the money was allocated. We assumed equal amounts bf money were 
spent each month of the project. 

71: Part of the project was done in FY71 . 

72: Part of the project was done in FY72. 

Subject Matter 

01 Reading/English/basic: Reading readiness, reading, composition, 
literature, grammar, punctuation, journalism, speed reading. 
Also |)rojects to teach "the basics"; i.e., very elementary 
reading and arithmetic. 

02 Math: Arithmetic, algebra, geometry, calculus, trigonometry, 
statistics, logic, and the like. 

03 Social science: The "soft sciences," history, geography, 
anthropology, sociology, psychology, economics, political 
science. Also business education, industrial psychology, 
and other courses leading to a master's degree in business 
administration. 

04 Medicine: Training in treatment and prevention of disease (for 
doctors, nurses, pharmacologists) as well as other topics related 
to health care, such as drug abuse. 

05 Engineering: Mechanical, civil, electrical, and industrial 
engineering. 
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Attitude chango} 

Integration, for exampU, (LlHe '*t^acl^ing fn^thodif/^M^ pt'ogf^iilO^ 
to Induce people to change .their attitude tj^w^rd a specif Jo -'^'^^ 
subject—e^g. , to get over a fear oV dislike of reading-^-ld 
coded as that subject matter — reading,) ' 
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Combination — Including nonclasslcal : More than one- subject 
matter, Including nonclasslcal and classical subjects, 
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Determining the Source of Funds 

Information on money was obtained from several sources. For the 
0E| funding was obtained from the POlS abstract. In three cases whero 
this Information was not on the abstracti we called the performer and 
asked. SRI checked the files of the Bureau of Education for the Handi- 
capped and corrected the dollar amounts for BEH funded abstracts* 



m 
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For DoD, money was sometimes on the DDC abstract. WTiere there was 
no Information under the amount of contract or grant, or under ''continuing 
duration of project, we got information from the performers, contracts 
and grants offices, and principal investigators. 

For NSF we got funding information from NSF Grants and Awards 1970^ 
1971, and 1972. For the few SIE abstracts not shown in NS7 Grants and 
Awards, we got the funding information from NSFs Contracts <ind Grants 
Office. 

When a project overlapped fiscal years ^ we used the following 
formula to prorate the money: 

dollars spent in FY no, of half-months iu that FY 

total dollars In project total half-months In project 

yfhere the month but no day of the month was given, we assumed the date 
was the first of the month. 



Data Reduction and Checks for Accuracy and Completeness 

Once we had coded the abstracts, we punched the data from each 
abstract onto cards, and aggregated the data with the aid of a computer. 
The analysis of that data appears in Section V of this report. Once we 
had gotten the data, however, v;e felt Lhufc we should check its accuracy 
and completeness. When we got our first results fr<Kn the PGIS system, 
we noticed large discrepancies between It and the data we got on OE 
frcHn the SIE. At the time, no one was able to explain the discrepancy, 
so we accepted the PGIS output as being the better representation of 
what actually occurred, and left it at that. However, before publishir^' - 
our results, we felt it wise to do some thorough checking. 

We checked the accuracy of the information we got from each of the 
Information services by calling a one-ift-ten sample of the principal 
Investigators on the projects, and asking them if the information appear- 
ing on the abstract was correct. The results of these accuracy checks 
showed that the <Jata from the information services was better than anyone 
connected with the information services had led us to believe. 

For the Office of Education, we called the recipient institutioits-- 
usually a contracts and grants office in a university, or ^a principal 
investigator. We made sure we were talking about the right project; we 
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asked if dollars and dates were correct. We verified content of the 
abstract when it seemed appropriate. The results of this check are 
tabulated below. 



Number of 

Category Projects 

Completely correct 19 

Partially incorrect substance 1 

Incorrect dollars 1 

Incorrect time 1 

Incorrect dollars and time 2 

Extension of time only (FY 71-72) 4 

Incorrect dollars and extension of time 1 

Subtotal ^ 29 

Refused to cooperate 5 

Total* 34 



For the National acience Foundation ^Vailed eitlier the performer 
or NSF Grants and Contracts office to check the accuracy of a sample, of 
SIE abstracts. We verified title, principal investigator^ performer, . 
dollars^ and dates. The results are tabulated Jbelow: 



* 

The reason that we had only 34 abstracts for a one-in**ten sample of 422 
prbjects is that often an abstract counts once for FY71 and once for 
FY72. The changes in dollar amount in each fiscal year were tabulated 
and found to be insignificant. 
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Checks of a sample of the entrlQfl in "NSF Ot'ants Wd A^ardft Annual** 
that had titles related td educational technology showed that titles 
w^ere a good Indication of project cpntent. 



For the pepartment of Defense > we cajlled several principal Ihvestl^ ^ 
gators and checked all varlajblest The results were: 



Catog!6ry 



Completely cotreot 
Incorrect type of tephn9l6gy 

J 1 

Incorrect type of R&D 

Incorrect time and subject matter 

'No response 



Jotal 



Number o:^' 
proje<?t». 

I 

2 
1 

• JL 

10 



MM 



%3 



W© checked the comipletendfls of the abstraetn on each . agency by TVS - 
different means. For the office of BduCiitioh, we consMlted two bur&aus \; .V 
ftJBkd^ jfc <?etalled description of tKe research proJeQ.ts.'that they ; 
ad ongoing during mi and PY72.' The bureaus thdt looked, at . 
the Bureau of Education of ti)^ Handicapped flMd th^' Bureau o£. Elem6»itft|'y^ . * 



In the Bureau of fediioatioh of the Hftndlcapped, many of the proj- 




technology (and other areas) were contacted. These people were able to 
tell "OS of nine projects that should have been included in our survey 
but were not. Of these, seven were in PGIS but were not covered by our 
list of keywords; the other two had never been entered into FGIS. The 
addition of^ the seven that were In PGIS would have caused a 17.5 percent 
increase in the number of projects sponsored by^ BBH; the two not in PGIS 
represent a 4 percent increase. If BEH Is one of the best bureaus in the 
Office of Education as far as record-keeping goes (and most of the people 
we spoke with both in and out of BEH agreed that it is), this suggests that 
the best we can hope is, that we have 80 percent of all the projects in 
the Office of Education concerned with educational technology. 

Our check of the Bureau of Elementary and Secondary Education showed 
that in the Office of Equal Educational Opportunity about one- third of 
the grants for FY71 and FY72 contained seme educational technology, but 
in no case was the amount of technology, arge enough for the project to 
be within our scope. In the remainder of BESE, we found a number of 
abstracts that we did not have, confirming the estimate of ccmipleteness 
we got from BEH — roughly 80 percent. 

We checked the completeness of the abstracts that we had on NSF by 
using their annual publication "NSF Grants and Awards." This publication 
lists only the title, principal investigator, and amount of each research 
grant. Judging as best we could by title, the abstracts that we had on 
NSF from SIE represented only about a quarter of the total number of 
projects and slightly less than a quarter of the money. This indicated 
that the Grants and Awards information was a more complete source of data 
than SIE. In order to verify this we made a check of roughly one-fifth of 
the projects listed that had titles indicating that they fell within our 
scope. This c^*cek was accompli shtju through telephone contact with the 
principal investigators. Altjjough some of these projects prove.d to be 
out of scope, the majority were in scope, indicating that the data on NSF 
from SIE is unreliable in the extreme. As noted elsewhere, we therefore 
used the Grants and Awards data for the NSF inventoh^^f R&D. 

We checked the completeness of the DDC abstracts by looking in detail 
at one organization: the Air Force Human Resources Laboratory, found' 
th«t our key words had failed to get us more than half of the projects with 
which this laboratory was concerned; of the ones left out, though, only a 
very small number proved to be in our R^npe once we had obtained abstracts 
on them. So it looks as though the DDC system gives us somewhat more 
complete information on the Department of Defense than we have on OF. 
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We also did a check of the reliability of our coding. We found that 
our reliability was about 90 percent; that is, considering all of the 
questions that were asked about all of the abstracts, there was over 90 
percent chance that a second coding of an abstract would produce the same 
results. -This imperfection of the coding system can be ascrlbed/to the 
lack of sufficient information on all of the abstracts to answer all of 
the questions. Wliere insufficient information was available, we were, 
forced to lise our Judgment. 
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Annex to Appendix D 



CHARACTERISTICS OF INFORMATION SERVICES 



Information Source 

SIE (Smithsonian Science Information Exchange) 

Location 

300 Madison National Bank Building 

1730 M Street, N.W. , Washington, D.C. 2o656 

A 

Types of Information 

SIE has on file abstracts of research in progre'ss under federal 
contracts and grants, and also a few abstracts submitted voluntarily 
by other groups. 

Methods of Accc* ss 

SIE offers a computer search that produces a set of abstracts of 
research projects that are filed under the key words you specify. 

Costs ^ • 

A computer search costs $50 for the search and the first 100 ' 
ab'^tracts, and $50 for each addltionel 100 or part of 100 abidtracts. 
If more than one search is done at a time, the initial cost for 
succeeding searches is $35 rather than $50. 

Not e s . ^ 

SIE provides excellent data on projects in progress. The only 
notable failing of the system is that SIE depends on the individual 
agencies to submit data; sometimes these agencies can get a, year or 
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two ]t>ehlnd in providing SIE with data, and, as a consequence, the 
usefulness of the system is curtailed. Also, the data for the cur- 
rent fiscal year comes out in the spring of that fAscaJ^^^BSk^s^-^tt^r^^ 
earliest, which means tMtr^tM^*--^y*'*^ ^^'^'^^'^ used for "advance 
jmrx^^B^^-^^nsn^ysts^ liii addition to getting information from federal 
agencies, SIE gets information from close to 100 foundations, and 
to a lesser extent from universities. SIE has several people assigned 
full-time to trying to get Information fx'om the federal agencies; 
all other contributions are just taken as^ received. SIE takes what- 
ever information is given to it; it does not have a staff to go out 
and bring data in or check the accuracy of the data received. SIE 
puts into the system just about everything it receives~it£: only 
judgments are made about private foundations; it only inputs research 
descriptions, not progress reports or general Information—some do it 
several times a year, and others once a year, |jf thiit. Contributions 
are processed as quickly as possible after they are received (the 
time it takes to get in the system depends on the workload at the 
time). Information is kept for close to three fiscal years; SIE has 
the^two most recent fiscal years and whatever the data bank will hold 
of the third. Only administrative data is kept In the computer; 
subject data Is stored on microfilm or microfiche. The.jnain aim. of 
the system is to keep the information on current projects readily 
available^ historical data can be accessed, but the research is more 
expi&nsive. SIE be^an in 1949 with two women in NIH; It is now funded 
by CongressWhrou^h the Smithsonian^ Institution. Data goes back to 
1949, but iS^ of ^arylng quality because the system has changed. There 
is a standard fqrm for input data, but only NIH uses it ; for the 
other agencies, /SIE translates data into its own form. Other than 
fran NIH (which/ is ^^^y reliable) SIE has no idea how good data from 
the agencies i/s., fl has formal contacts with JWIS and the. Library 
of Congress. / . y^'^ ' . 

Typical absyracts are shown in Figures D-1 and D-2 ^ . 
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SMITHSONIAN 
SQENCE INFORMATION EXCHANGE, INC 
1730 M sriiKrr, n.w. phonc 2oa->«i-«9ii 
wAVHiMaTON. o.c, aoo>« 

NOTICE OF RESEARCH PROJECT 



H^ALTB, EDUCATION S VELFARB EPOIIIOS 
OFFICE OF EDUCATION CONTRACT 

NATL. CTR. FOR ED. RES. S DEV. BR-8-0157 . 

TtTLj: or pnojKCTt 

A SYStEH FOB INPI VIDQALIZING AND OPTINIZING LEARNING THR0U6R COHPDTBR 
HANAGEHEWT 07 THE EDOCAT: . ONAL PROCESS 



FIIINaFAL mVCSTiaATOM. AtSOCIAtftS AND OCrARTMKNT/SrCCtALTYl 

BBRTRAN 



PtCClPIKNT INSTITUTION t 



PCmOD FOB THIS NRfi 



NEtf YORK INST. OF TECHtfOl. 
UNDERGRADDATE SCB06L 

NEN YORK, NEW YORK 10023 



7/71 TO 
PY72 



6/72 



SUMMARY or PROICCTt 



A COnPUTEa*BASED INSTRdCTIONAL HANAGEKENI SYSTEH tfILt BE DBVBIOPBD 
AND TESTED. THE SYSTEfl Mill BE ACAPTIVB TO PROVIDE AN OPTIWI! 
INSTRaCTIONAL SYSTEHS DESIGN. i^LEHENTS OF THE SYSTEK MODEL ARE <1) / 
CURRICULUM BEHATIORAt OB<':ECTIVESr (2) STUDENT CHARACTERISTICS PROFILES 
AND SELECTION CRITERIA, (J) I N5TR0CTI0NAI MATERIALS, OBJECTIVES, AAO 
CONTENT, ((i) INSTROCTICNAL STRATEGIES, (5) EVALUATION INSTROHENTS AND 
PROCEDURES, (6) INSTRUCTIONAL DECISION MAKING, (7) ORGANIZATION AND / 
FACILITIES, AND (B) FEECBACK AND RESTRUCTURE MECHANISMS. THE. SYSTEM NItt 
BE USED TO MANAGE INDIVIDUALIZED EDUCATION AND TRAINING. IT tfILL BE / 
GSEFUL AS A DIAGNOSTIC TOOL, FOR PRESCRIBING iNSfROCTIONAt MATERIALS AlID 
SEQUENCES, AND FOR COST-EFFECTIVENESS EVAIHATIONS. ADDITIONALLY, IT NILL 
PROVIDE AN EMPIRICAL BASE FOR REFINEMENT AND DEVELOPMENT OF CURRICULUM 
MATERIALS. (NN) ISG 



FIGURE D-l EXAMPLE NO. I OF S IE ABSTRACT ; 
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SMITHSONIAN 
SQENCE INFORMATION EXCHANGE. INC. 
1790 M STRtrr* N.w« FHONC aoa>$at-«sit 
WASNiNaroN, o.c« aoo>« 

NOTICE OF RESEARCH FROJECt 



3GI-120-3-1 



• U^^ltTINQ AOKNCVt AQKNCV'S NUMfteft(l)t 

BI^IITH, BDUCATIOH & HELFAHE PE 00040-^0351 
PUBLIC HEALTH SERVICE 

MATIOMAL INSTITUTES OP HEALTH 



WATIOITaL LIBBAFY op MFPIClUg 



TITUK or rnajKcn 

CCHPOTER ASSISTED IKDEPEKD5NT STUDY - A PILOT PHOGRAIf 

"^"1 I^RINCirAL INVUTVOATOn. ASftOCIATKS AND OKPAflTKKNT/«PCCIAt.TYT 

DR JA PRIOR 
J? GRIESBN 
RL POLK 



AKCIPIKNT tN»TlTUTlOm PERIOD FOR THll NRPi 

OHIO STATE ONI?ERSITY 6/71 TO 5/72 
SCHOOL OP HEDICINE PY71 
190 H. OVAL DR., 102 ADBI »XSTR ATIOM BLDG. 
COLUMBUS, OHIO ft3?1Q : 

SUM MAR r or rROulCCTt 



The progcdib is concerned frith the aj^plication of independent study 
Methods in the education ot nedical students in the pre-clcrkship phase 
Of their curriculua. We have designed, developed, and are nov 
ivpleaenting and evaluating this aethod of instruction for thirty-tvo 
aedical students under the franework of a. separate pilot school vithin 
the College pf Hedicine. The prograa includes a verticalized curriculua 
nith instructional aethods applicable to independent study, coaputer* 
assisted self evaluation prograas, coapater acnitoring of student 
progress and a detailed cost analysis prograa. The prograa provides for 
independent tracts in the curriculua and allows for independent rates of 
advanceaent. Evaluation vill include coaparison of student perforaance 
aith aatch control groups in the standard curriculua* ISO 



F IGURE D-2 EXAMPLE NO. 2 OF SIE ABSTRACT 
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Inform ton Source 



NTIS (National Technical Information Servtc^) 
Location 

5285 Port Royal Road, Springfield, Virginia 22151 



" type of Information 

\ OTIS has on file the full texts and abstracts of reports resulting 

tvom government sponsored research and development and other govern-* 
ment analyses prepared by federal agencies, their contractors, or 
grantees • 



Methods of Access 

NTIS offers a computer search that produces a set of abstracts of 
papers that are filed by the key words you specify. NTIS also 
publishes abstracts (and indices to them) in a series of subscrip- 
tion Journals in various areas of interest. JfTlS also offers a 
variety of other Information services. 



Costs 



A computer search costs $50 for the search and the first 100 abstracts, 
and an additional $25 for each 50 or less abstracts. The cost of 
documents depends on^ the cost to NTIS of duplicating and handling 
them, and ranges from a couple of dollars to over ten dollars. 



Notes 

NTIS produces essentially a huge annotated bibliography of papers 
put out with government money. It suffers some of the same problems 
as ERIC as a source of information for current projects. Over 225 
agencies and private Industry input technical and scientific informa- 
tion liito the NTIS collection. Virtually all federal agencies con- 
tribute, espi^cially NASA, the Bureau of Mines, the Department of 
Labor, and the Atomic Energy Commission. NTIS only handles documents 
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that are submitted to it, and it uses everything submitted. M&inly 
these are technical reports and Journals; few are books. NTIS 
prints everything word for word. Document input is irregular, since 
the various agencies Just send a document along as soon as it is 
done« Because of space limitations, some of the older series have 
been transferred to the Library of Congress, but NTIS does keep the 
more recent ones, A lot of the publications announced by NTIS are 
not sold by them — rather, the Government Printing Office sells than. 
NTIS does make and sell microfiche copies of everything submitted 
to it, NTIS has. an index by title and reference number, which also 
includes source, author, and price; this is also for sale (at a 
fairly high price). NTIS is 90 percent self-sufficient, but is part 
of the Department of Commerce and gets some money from Congress. 
NTIS began Just after World War II (it used to be called the Clearing- 
house for Federal Scientific and Technical Information), and its cut- 
-off date for material was 1945; there are no records before that* 

Typical abstracts are shown in Figures D-3 and D-4. 
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Leacner Control of Jkatoaated Instructioa 



Florida State UniT Tallahassee Coiputer-Assistei Instraction Center 
(U05060) 

AOrROR: BrovQ, .Bobby R. , Ranse&ff Oaacan N., Thoaas, Davii B., King, 
Arthur D. ^ 

Technical rept. (Final) 

A2763C1 FLD: 51, 56E u7119 

30 ing 70 39p 

COMTBACT: 1I61339-68-C-0071 

MTTBADB?CE!l-68-C*0071-3 

ABSTRACT: The effects of three variations of learner control and one 
instructor control condition were investigated. The three types of 
learner control chosen for investigation were: selection of 
■edia^device, and selection of infomtion load; selection of 
repetition by branching; and selection of topic sequence. The results 
observed for learner control of /sequence in this study, when 
considered in the light of other studies, strongly suggests that the 
asount of inforaation presented to guide student decisions In 
sequencing nay be „ a critical variable and one which shoulid be 
investigated in aore detail. (A'^uthor) 

DBSCBIPTOBS: (^'prograaned insltruction. Control), , Training devices. 
Con put er storage devices 

IDEBTIFIBBS: *CoBput.er aided instruction 

AI>-72d <»29 BtIS Prices: PC$3.00 HFS0.95 




FIGURE D-3 EXAMPLE NO. I OF NT IS ABSTRACT 
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the Design of an Abstract flierarchical LearDing Task for 
Coaputer "Based Instructional Besearch 

Texas Oniv Austin Coapater-'assisted Instructioa Lab (406689) 

aOTHOR: Bonderson, C. Victor, Olivier, Rilliaa P., Merrill, Paul T. 
Technical rept. 

FLD: 51, 56B U72t8 
atig 71 20p 
RBPT HO: TH^2 

COHTBACT: H00014-67-a-0126-0006, ABPA Order-1261 
PBOJBCT: llB-15a-282 

ABSTBACT: An instructional design aodel inspired by a cross 
fertilization between ideas from the different disciplines of / systea 
analysis, curriculua design, and coaputer prograaaing was dsTeloped. 
The paper describes a hierarchical learning task which was designed 
and developed in accordance with the instructional design aodel to 
study guestions concerning task strucmre, seguencingf and other 
instructional design variables* (Author) 

0KSCBIPTOBS: (^Learning, ^Prograaaed instruction). Design, 
Sisulation 

IDEVTIFIBBS; ^Coaputer aided instruction, Inforaation 

processing (Psychology) 

AD-7a5 717 BTIS Prices: PC$3.00/BF$0. 95 



F IGURE D-4 EXAMPLE NO. 2 OF NT IS ABSTRACT 



D«28 



Information Source 



ERIC (Educational Research Information Clearinghouse) 



Location 

There are regional clearinghouses scattered across the United 
States; the address for requesting documents is; 

« 

ERIC Document Reproduction Service 

P.O. Drawer O 

Bethesda, Maryland 20014. 

" / ■ • 

Type of Information 

ERIC keeps on file documents and their abstracts. The documents 
are all on education and closely related topics, and are all 
. submitted to ERIC by the authors (or others), except for a few 
that are commissioned by ERIC itself to fill a recognized need. 



Methods of Access 

ERIC offers several methods of accessing its files: (1) a computer 
search facility (run by Lockheed) will give you abstracts of ERIC 
papers that are filed by the key words you specify, (2) ERIC 
publishes an indexed monthly list of abstracts of new papers, 
and (3) ERIC has yearly indices that list the titles and accession 
numbers of documents by key words. 



Costs 

A computer search costs $35 an hour for computer time plus $0.20 
per abstract printed out, so 400-500 copies might cost a few hundred 
dollars. The document costs run from $0.65 a copy (for microfiche) 
to hardcopy costs of $3.29 per hundred pages. 



Notes 

ERIC is excellent for providing background , material in any investiga 
tlon of an educational topic. It includes most of the major 
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publications pertaining to education, with the exception (most of 
the time) of material published in educational perl odicalB -and- -books, 
by major publishing houses. As a way to inventory work being con- 
ducted in the field, it is less than satisfactory because (1) often 
papers are entered into ERIC years after they are written, (2> cover- 
age is sc»newhat haphazard because It depends on submission rather 
than solicitation, and (3) many of the papers have little or nothing 
to do with ongoing research and experimentation, > 

The ERIC Center for Media and Technology (housed at Stanford 
University) says It gathers two-thirds of its Information itself 
through affiliations with about 25 professional organizations in 
the field of educational media and technology. It covers conferences 
and speeches in the field, and also gets material from state and 
county boards of education and other branches of government involved 
in education. It subscribes to about 50 journals and newsletters, 
and sends for bibliographies. Also, it looks at Master ^s and Doctoral 
Theses done in the area of educational media and technology. The 
clearinghouse sends an average of 20-25 documents (some' are mer^ . ^ 
citations^ to Central ERIC each week, where they are put on micro- 
fiche and hardcover and microfiche copies are made available. Each 
document Is screened for relevance by two or three people — each one 
is supposed to be relevant to the concerns of researchers and timely 
(produced wilhiu the last year). Once in the system a document is 
in permanently — no information is ever discarded. Each document 
takes about three months to be listed^ Central ERIC determines the 
format for inputs to the system; its thesaurus is based on the NTIS 
thesaurus. It automatically screens all documents that go into NTIS, 
and puts into ERIC those that are relevant to education (roughly one 
percent). ERIC is funded by the National Institute of Education, and 
has been in existence since 1965» The media and technology clearing- 
house has been in existence since 1968. Although generally ERIC 
only inputs current documents, it has gone as far back as 1949 (to 
pick up Pennsylvania State College's research done for the Navy on 
flight training films, which was the basis for all later studies 
of film). 

Typical abstracts are shown in Figures D-5 and EH6. 
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PAGE 221 (ITEM 279 OF 450) 



BD055a29 BflO09276 

COHPOTBR-BASBD IHSTBOCTIOH; A BACKGROUND PAPER DN ITS STATUS^ 
C0ST/2PPBCTI?BlfBSS AND TELECOHHQK ICATIONS HEQUIBEHBNTS. 

Sinqhr Jai P.; Hocqan, Robert P« 

VashiDgton Oniv.r St. Louis, Ho. 

Spons Agency-Hational Aeronaatics and Space AdBinisttation, 
Sashlngton, D.C. 

Report HO.-IK-71-1 2 
PQb Date 10 Apr 71 9ote-40p. 
EDBS Price HP-$0.65 HC-S3.29 

Descriptors-^COMQDication Satellites/ *Coapatpr Assisted 
InstructioD/ ^Cost Effect ire ness/ ^Educatioo^l Technology/ ^Program 
BwaluatioL/ Resource Allocations/ Rural Education/ Telecomnunicat ion/ 
Telephone Conmnications Industry 

Identifiers'CBI/ ^Conpater Based Instruction 

In the slightly over twelve ^years since its inception, 
cosputer-based instruction (CBI) has shown t^ 9 pronise of being nore 
cost-effective than traditional instruction for certain educational 
applications* Pilqt experinents are under vay to evaluate various C^I 
sfsteas. Should these tests prove successful, a major problen 
confronting advocates of large-scale C 31 utilization is the conflict 
batveen the organization of traditional school systeas and optinal 
methods of utilizing CBI. Large-scale and intensive utilization is the 
key to low per-pupil costs* Sone neans of lov-cost telaconnunications 
■ast be found if rural conaunities and sparsely populated regions are 
to benefit* Coanunication satellites seen to hold distinct advantages 
over existing connercial telephone connunications for lintcing renpte 
terminal clusters with a central conputer vhere conputer-clu^er^ 
separation is ISO- 200 ailes or greater. This neaorandun- incTudes a 
discussion of the larger issues involved in CBI and a sunaary of 
experiaents and costs of a variety of CBI experiments and approaches* 
(Author/JI) 



FIGURE D-5 EXAMPLE NO. i OF ERIC ABSTRACT 
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PAGE 223 (ITEH 281 OF USO) 



BD055427 EI!00927iJ 

INSTBOCTIOMAL TELEVISIOIT UTILIZATION lb THE ONITBD STATES. 

DuHolin, Janes B* 

llashiogton Univ., St. Louis, Ho. 

Spons Agency^Kational Aeronautics and Space Administration, 
Hashing ton, D.C. 
Beport HO.-HII-71-6 
Pub Date Oct 71 Ilote-a9p. 
BDBS Price Hr-$0.65 HC-$3. 29 

Descriptors-Cable Television/ Coaaunication Sp.tellites/ Cost 
Effectiveness/ ^Educational Television/ ^Facility Utilization Research 
/ Fixctd Service Television/ Instructional Hedia/ ^Instructional 
Television/ ^Material Development/ Programing (Broadcast)/ Teachor 
Attitudes/ Teacher Education/ Televised Instruction/ Television 
Besearch 

Identifiers-Appalachia Educational Laboratory/ Sesame Street 
Various aspects of utilizing instructional television (ITV) are 
summarized and evaluated, and basic guidelines are developed for 
future 4itilization of television as an instructional medium. The role 
of technology in education is discussed, a|id the capabilities and 
limitations of television as an instructional media systef are 
outlined. A brief review of the state of ITT research is presented* 
Examples of various ongoing ITV programs are described, and the 
possibilities inherent in ITV are summarized. The three stages 
involved in delivering instructional programing to the student via 
television*- production, distribution, and classroom utilization^-^are 
described. A summary analysis outlines probable trends in future ITV 
utilization. (Aathor/JT) 



FIGURE D-6 EXAMPLE NO. 2 OF ERIC ABSTRACT 
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Information Source 



FGIS (Projects and Grants Information Systems) 
Location 

In the Office of Education, basement of 400 Maryland Avenue, S.W,, 
Washington, D.C. 

Type of Information 

PGIS keeps on file, abstracts of all ongoing projects and all pro- 
posals received. Most of the information on the abstract is obtained 
from the proposal submitted by the (prospective) perfcriper; the 
information is not always updated if It is changed during the nego- 
tiations and the writing of^the contract. 

F 

Method of Access 

PGIS used to offer several methods of accessing its data fileS| but 
in the last year or two Its budget has been cut to the point where 
it only offers a key word sea;frch. A list of project and proposal 
titles associated with each key word is produced on request; from 
this list those projects or proposcQs desired are chosen. A list of 
X accession numbe\rs of the chosen items is theh input to the computer 
which outputs the abstracts associated with each number. 



Costs • 

Since PGIS was set up solely for internal use, there was no charge 
for our use. Howeveir, any person wishing to access the system who 
was not working fairly directly for the Office of Education would 
have to make some special arrangement (which might involve payment) 
with OE's Office of Public Affairs. 



Notes 




Information is put into the system continuously; an annual or semi- 
annual purge is done of all outdated information; proposals that 
are not funded are dropped^^fi'om the' system as soon as they are 
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rejected. Although an instruction manual and forms are provided 
for people to input data to the system, the data do not include all 
of the items aboUt a contract pr grant. PGIS is funded almost 
entirely by the Office of Education, although a small part of its 
budget is (or was) provided by other agencies. It has institutional 
ties with ERIC (all reports produced as a result of OE contracts are 
sent to ERIC) ; the people we talked to knew of no other formal insti- 
tutional ties with other information systems. 

Typical abstracts are shown in Figures D*-7 and D-8. 
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WC (Dof^n^o pocumentfit Ion Center) 



III 



3Mf 



bDC has on fUo (If receive^!) "wotk units'* covej^ing every, project 
funijecj by the pepartment of Ip^^ense*— pastt presents and j som^ futurHif,^^^^^^^^^ 
Including both in-hoMse and contracted work^ T^e^lflfbrjfi^^^^ 

. ■ ; ;ac 

Information we received doOS not represent tlie fyll amour^t of i/rif6rma«r^i 
lion on file J apparentXyt we got only ais much as^ our ^nedd^:t6 
seemed tq^stify. / ^ . ' . ( / 



Method of Access 



DDC offers a computer search on key words that produc^es a list of 
work units <i*e.i ongoing projeUs) mnd reports areas of ti;? 

- key .vvoi^ds. , ^ r'^ ' - 



Costs 



There |s no cost to a qualified user, 



Notes 



As fa^ as we could 
,| the amount of information not included in the system due to 



DDC sterns a complete and up-*to-date service, 

lack /of input was very smallv Kowever, since the military operates 
toward different goals than do any of the agencies/ operating tM 
otheir information sources that we accessed » a mor^ Inclusive set of 
key /words was needed (we are still not sure ihat we have all .the 
relevant abstracts). / * 
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Typical abstracts.are shown in Figures D-9 and DrlO. 
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DOC ro^iH4T '«Oo?* • 



ItltNOll UNlVC«$ltY or U^ftANA 

III 

t^JttNfll^Ay INVCSTICATOR 



R£S*»ON$UlC <J0VT OHtCfANI nation 
A^ HUMAfJ '^CSOU^CCi'lAilOftAToRY 
ft lOWftY Ars, COIORAOO dOlJO 

• - 'ASSOClATC UveSTiOATOR 

■ rHUo^-^Ti-c-ooio 



^tHroRMANCC MCTHOO 
CdNTRACt 



CONT^ACT/C^Ayt AMOUNT 



&AVe or: fUHHARY 
do HAH 71 



START rtATi 



EST rHATCO COHPlCTfON OATt 
JUN 73 



KINO 0r SUMMARy- SUHMAi^y' ^t4UR I T ^ 

CMANGC UNClA^Sir tCD 



WORK secMJiiTy 

UNClASSir jED 



SCieVlTfirIC AND Tc CNNOLOO I C Al AREAS 

. OK100 PERSONNEL S t LE CT I ON/ TR A I N I . AND CVaIUATION 

01^^00 Personnel selection traIn]>jo and evaiuation * 
ooHjoo Computers ' ^ 

KtVNORO^I J ' ' ' 

OB^ECTIVET <U> TO OaTA|N rOUR PIASmA '»ANtt CONSOLES fTERHlNALSt 
WITH RrM6TE TJMESHARED COnruTf R SUPPORT tN 6«DCR TO DEMONSTRATE 
AND EVALUATE THE CONSOieS ANO THE COHPUTER HARORARC/SOrTWARr . 
CAPABltr^> rOR POSStfiLE USE IN TECHNICAL TRaINIKC AN^ POR ThE A|A 
POLICE aPvI[NCEO INSTRUCTIONAL SY<TEh' iAlS>» 

APJ»R<>AC^H| : iUl THE tN|T lAL APPROACH RiLt CONSIST OP iHt OrC I VERY 
ANO INSTALLATION OP TRO I^LATO' |V IPROO^AMHEo lOOIC PO^ AUTOHATK 

ttAcHlN^ pPERATlONSiiSTUOENt^CONSOLESi THESE «UL CONSIST Of 
l»tAS«A PANEL OlS^(.AT» KEYSET^ AND COMPUTER CONTROLLEO fNA<3E. 
PROjECtOJ^* INSTALLATION or THP .REHA|NIN<G T«o CONSOlf S RILL dE 
ACC0MPL ISHEO l>U^tNG' THE r |RST %tt MONTHS OP THE 'CONTRACT* r OUR 
TOUCH INPUT SYSTEMS AS AUXILIARY EOUirMENT TP JTHE STUDENT 

coNsoi.es CONE ro^ Each console » witi also re installed our i no 
THIS <»E*trpo» INCLUDED • 1 This crroRT a^c The csTASirSMH^Nf and 

HAINTCNaAcE or an iNTERrACE to the OOVC^NHEf^lT COMhUNlCATIOKl , 
LlNKSi ACCESS TO THE PLATO I V COHRuTf*! TUTO** UANOUAOE |A 
sort* ARE INNOVATE or THt PLATO IV I CM |S pR|ENTED TO 
fOUCATlONAL NEEDS)! AND PIATO IV SvStl'^S RROfl^^AM TO AtL0* 
AUTHORING or UNcLASSiriED COURSE HATftlAlS, PROdftAMHtNG 
ASSISTANCE RlCt AtSo 6£ r RO V | oEO A S REOU I RED $V COURSE AUTHORS* 



DISTRIBUTION INSTRUCrlONI UNL IMITED 



ACCESSION NUHSERt Dr2201^«0 



f IGURE D-9 IXAmi NO. I OF DDC ABSTRACT 



UNCLASSIFIED 
OOC RpPORT NUMPFR :W|l79, JUL 03* 1973 
OOC FORHAT BC07S 



CU) CSP/EOST TRAINING IMPROVEMENT 



title: 

PE^FntMTNG ORGANIZATION 
SYSTEM aEVELOFMCNT CORPO'»ATloN 

2500 COLORAOO AVENueI SANTA 
MON I C A , CALIF 90M06 

PRINCIPAL INVESTIGATOR 
MEC0ZZ2 . J 

TELEPHONE NUM8f» \ 
2I3-393-9MII 

PERFORMANCE METHOD 
CONTRACT 

OATE OF SUMMARY START OaTE 

5 NOV 72 APR 7I 

KINO OF SUMMARY 
CHANGE 

SCIENTIFIC ANO TECHNOLOGICAL AREAS 
011700 OPERATIONS RESEARCH 

00<490«^ OEFENSE 



rcSponsirlE govt organization 

oEFENSE cIVIL PREPaREONESS 
AGENCY WASHINGTON, O.C. 20301 

ASSOCIATE Investigator 



contract/gRant number 

0AHC20-7 I -0288 

contract/gRant amount 

$ 60«000 

ESTIMATED COMPLETION OATE 
NOV 73 

•ORK SECURI TY 
UNCLASS I^ lEO 



SUMMARY SECUR | JY 
UNCI ASS I F I EO 



keywords: EMERGENCY OPERATIONS MU) SIMULATION EXERCISE ICU) 

TRAINING M'J) NUCLEAR ATTACK t 

objective; lU) to update and modernize The materials and methods 

USEn IN SIMULATf f) TRAINING FOR NUclEAR ATTACK. TO PREPARE THE 
MATpRlAL.FOR SIMULATION OF ACTIONS gY THE EMERGENCY OPERATING 
SERVICES, FIRE POLICE. PUBLIC wORKs, ETC, DURING SUCH AN ATTACK, 
THE MATERIAL AND METHODS ABOVE SHOulO BE GEaRED TO INCREASE JhE 
QUALITY OF TRAINING OF CoMMuNItV OFFICIALS* DEPARTMENT HEADsii 
CITY LEftOERS AND ALL PARTICIPANTS IN CIVIL DEFENSE OPERATIONS FDR 
A NUCLEAR ATTACk. 

APPROACH* lU) TO Review the state df the art or nuclear weapons 

OF THE I ATE I96D*S AND ACAPT^ThE SIMULATION TRAILING TO THESE, TO 
MULTIPlF WEA-PONS DETDNaT I'ONsT to air and ground lURSTS AND TO THE 
MECHANISMS OF DEFENSE RECENTLY DEVELOPED OF SHELTER PLANN I NG AND 
UPGRAOtNG, HOME FOLLOW SHELTER P R 0 T T C T I 0 N , . ft L A S T P RD T E C T I ON IN 

BELOW GROUND SHELTERS |N ADDITION To SUPPRESSION DF IGNITION SELF 
HELP IN FiREFlGHTINf,, REMEDIAL MOVEMENTS AND DECONTAMINATION. 

DISTRIBUTION Instruction: unlimited , ' 

access I ON NUMBER: DCDD0 6-2D 



F I CURE D-IO EXAMPLE NO. 2 OF DDC ABSTRACT 
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